tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.e1FYFiPSVb', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 10882c1f-d19a-414d-bab8-6c52fec2d85f gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. (finished: start all VMs, in 68.37 seconds) gitlab: waiting for unit setup-gitlab.service gitlab: waiting for the VM to finish booting gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)... gitlab # gitlab # gitlab # gitlab # gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB00 gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)... gitlab # gitlab # gitlab # Booting from ROM... gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y7c8gk2v0hms0dmaacj4qqb9msxj3wv8-nixos-system-gitlab-test/init regInfo=/nix/store/c6p1qaa7k7cvxx0mxz4kxmp7wqbpqzzm-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.000000] BIOS-provided physical RAM map: gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved gitlab # [ 0.000000] NX (Execute Disable) protection: active gitlab # [ 0.000000] APIC: Static calls initialized gitlab # [ 0.000000] SMBIOS 2.8 present. gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 gitlab # [ 0.000000] DMI: Memory slots populated: 1/1 gitlab # [ 0.000000] Hypervisor detected: KVM gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 gitlab # [ 0.000000] kvm-clock: using sched offset of 457339933 cycles gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor gitlab # [ 0.000806] last_pfn = 0x1c0000 max_arch_pfn = 0x10000000000 gitlab # [ 0.000834] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs gitlab # [ 0.000837] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x10000000000 gitlab # [ 0.002739] found SMP MP-table at [mem 0x000f5470-0x000f547f] gitlab # [ 0.002752] Using GB pages for direct mapping gitlab # [ 0.002893] RAMDISK: [mem 0xbe31c000-0xbffcffff] gitlab # [ 0.002902] ACPI: Early table checksum verification disabled gitlab # [ 0.002905] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) gitlab # [ 0.002909] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002914] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002922] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002924] ACPI: FACS 0x00000000BFFE0000 000040 gitlab # [ 0.002926] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002927] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002929] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) gitlab # [ 0.002930] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2] gitlab # [ 0.002931] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e] gitlab # [ 0.002932] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f] gitlab # [ 0.002932] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482] gitlab # [ 0.002932] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba] gitlab # [ 0.002933] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2] gitlab # [ 0.003165] No NUMA configuration found gitlab # [ 0.003166] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff] gitlab # [ 0.003168] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff] gitlab # [ 0.005496] Zone ranges: gitlab # [ 0.005497] DMA [mem 0x0000000000001000-0x0000000000ffffff] gitlab # [ 0.005498] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] gitlab # [ 0.005499] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005501] Device empty gitlab # [ 0.005501] Movable zone start for each node gitlab # [ 0.005502] Early memory node ranges gitlab # [ 0.005503] node 0: [mem 0x0000000000001000-0x000000000009efff] gitlab # [ 0.005504] node 0: [mem 0x0000000000100000-0x00000000bffd7fff] gitlab # [ 0.005505] node 0: [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.005506] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff] gitlab # [ 0.005527] On node 0, zone DMA: 1 pages in unavailable ranges gitlab # [ 0.005797] On node 0, zone DMA: 97 pages in unavailable ranges gitlab # [ 0.120522] On node 0, zone Normal: 40 pages in unavailable ranges gitlab # [ 0.120966] ACPI: PM-Timer IO Port: 0x608 gitlab # [ 0.120990] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) gitlab # [ 0.121029] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 gitlab # [ 0.121032] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) gitlab # [ 0.121034] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) gitlab # [ 0.121036] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) gitlab # [ 0.121037] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) gitlab # [ 0.121037] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) gitlab # [ 0.121040] ACPI: Using ACPI (MADT) for SMP configuration information gitlab # [ 0.121041] ACPI: HPET id: 0x8086a201 base: 0xfed00000 gitlab # [ 0.121048] TSC deadline timer available gitlab # [ 0.121053] CPU topo: Max. logical packages: 1 gitlab # [ 0.121054] CPU topo: Max. logical dies: 1 gitlab # [ 0.121054] CPU topo: Max. dies per package: 1 gitlab # [ 0.121058] CPU topo: Max. threads per core: 1 gitlab # [ 0.121058] CPU topo: Num. cores per package: 4 gitlab # [ 0.121059] CPU topo: Num. threads per package: 4 gitlab # [ 0.121059] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs gitlab # [ 0.121086] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() gitlab # [ 0.121105] kvm-guest: KVM setup pv remote TLB flush gitlab # [ 0.121108] kvm-guest: setup PV sched yield gitlab # [ 0.121125] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] gitlab # [ 0.121127] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] gitlab # [ 0.121128] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff] gitlab # [ 0.121130] [mem 0xc0000000-0xfeffbfff] available for PCI devices gitlab # [ 0.121132] Booting paravirtualized kernel on KVM gitlab # [ 0.121135] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns gitlab # [ 0.125623] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1 gitlab # [ 0.127941] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288 gitlab # [ 0.128004] kvm-guest: PV spinlocks enabled gitlab # [ 0.128005] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear) gitlab # [ 0.128009] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y7c8gk2v0hms0dmaacj4qqb9msxj3wv8-nixos-system-gitlab-test/init regInfo=/nix/store/c6p1qaa7k7cvxx0mxz4kxmp7wqbpqzzm-closure-info/registration console=ttyS0,115200n8 console=tty0 gitlab # [ 0.128112] Unknown kernel command line parameters "regInfo=/nix/store/c6p1qaa7k7cvxx0mxz4kxmp7wqbpqzzm-closure-info/registration", will be passed to user space. gitlab # [ 0.128127] random: crng init done gitlab # [ 0.128127] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes gitlab # [ 0.137934] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.142577] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.142669] software IO TLB: area num 4. gitlab # [ 0.223118] Fallback order for Node 0: 0 gitlab # [ 0.223128] Built 1 zonelists, mobility grouping on. Total pages: 1572726 gitlab # [ 0.223130] Policy zone: Normal gitlab # [ 0.225879] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.236325] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.250615] allocated 12582912 bytes of page_ext gitlab # [ 0.261656] ftrace: allocating 48717 entries in 192 pages gitlab # [ 0.261658] ftrace: allocated 192 pages with 2 groups gitlab # [ 0.262649] Dynamic Preempt: lazy gitlab # [ 0.262859] rcu: Preemptible hierarchical RCU implementation. gitlab # [ 0.262860] rcu: RCU event tracing is enabled. gitlab # [ 0.262861] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.262862] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.262863] Rude variant of Tasks RCU enabled. gitlab # [ 0.262863] Tracing variant of Tasks RCU enabled. gitlab # [ 0.262864] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. gitlab # [ 0.262865] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.262891] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.262893] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.262894] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.267470] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16 gitlab # [ 0.267772] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.267781] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns gitlab # [ 0.267906] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.271485] Console: colour VGA+ 80x25 gitlab # [ 0.271488] printk: legacy console [tty0] enabled gitlab # [ 0.302250] printk: legacy console [ttyS0] enabled gitlab # [ 0.400165] ACPI: Core revision 20250807 gitlab # [ 0.401097] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns gitlab # [ 0.402613] APIC: Switch to symmetric I/O mode setup gitlab # [ 0.403562] x2apic enabled gitlab # [ 0.404328] APIC: Switched APIC routing to: physical x2apic gitlab # [ 0.405243] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask() gitlab # [ 0.406402] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself() gitlab # [ 0.407818] kvm-guest: setup PV IPIs gitlab # [ 0.409356] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 gitlab # [ 0.410377] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.412094] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008) gitlab # [ 0.413179] x86/cpu: User Mode Instruction Prevention (UMIP) activated gitlab # [ 0.415212] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 gitlab # [ 0.417090] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 gitlab # [ 0.418095] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto gitlab # [ 0.420091] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl gitlab # [ 0.421091] Transient Scheduler Attacks: Vulnerable: No microcode gitlab # [ 0.422859] Spectre V2 : Mitigation: Enhanced / Automatic IBRS gitlab # [ 0.423829] Speculative Return Stack Overflow: Mitigation: Safe RET gitlab # [ 0.424888] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization gitlab # [ 0.426098] Spectre V2 : Enabling IBPB for BPF gitlab # [ 0.427091] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier gitlab # [ 0.428092] active return thunk: srso_alias_return_thunk gitlab # [ 0.429112] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' gitlab # [ 0.430091] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' gitlab # [ 0.431091] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' gitlab # [ 0.432900] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' gitlab # [ 0.433910] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' gitlab # [ 0.434893] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' gitlab # [ 0.436090] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' gitlab # [ 0.437092] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 gitlab # [ 0.438090] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 gitlab # [ 0.439090] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 gitlab # [ 0.440091] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 gitlab # [ 0.441091] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 gitlab # [ 0.442090] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. gitlab # [ 0.472014] Freeing SMP alternatives memory: 44K gitlab # [ 0.472654] pid_max: default: 32768 minimum: 301 gitlab # [ 0.473202] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.474209] landlock: Up and running. gitlab # [ 0.475581] Yama: becoming mindful. gitlab # [ 0.476315] LSM support for eBPF active gitlab # [ 0.477484] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.478256] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.481688] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) gitlab # [ 0.482777] Performance Events: Fam17h+ core perfctr, AMD PMU driver. gitlab # [ 0.483096] ... version: 2 gitlab # [ 0.483828] ... bit width: 48 gitlab # [ 0.484093] ... generic counters: 6 gitlab # [ 0.484836] ... generic bitmap: 000000000000003f gitlab # [ 0.485143] ... fixed-purpose counters: 0 gitlab # [ 0.485910] ... fixed-purpose bitmap: 0000000000000000 gitlab # [ 0.486821] ... value mask: 0000ffffffffffff gitlab # [ 0.487093] ... max period: 00007fffffffffff gitlab # [ 0.488002] ... global_ctrl mask: 000000000000003f gitlab # [ 0.488907] signal: max sigframe size: 3376 gitlab # [ 0.489672] rcu: Hierarchical SRCU implementation. gitlab # [ 0.490096] rcu: Max phase no-delay instances is 400. gitlab # [ 0.491166] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.496711] smp: Bringing up secondary CPUs ... gitlab # [ 0.497514] smpboot: x86: Booting SMP configuration: gitlab # [ 0.498103] .... node #0, CPUs: #1 #2 #3 gitlab # [ 0.501272] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.503095] smpboot: Total of 4 processors activated (19200.06 BogoMIPS) gitlab # [ 0.504455] Memory: 6011620K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved) gitlab # [ 0.507094] devtmpfs: initialized gitlab # [ 0.508261] x86/mm: Memory block size: 128MB gitlab # [ 0.511265] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.513137] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.514187] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.515357] PM: RTC time: 17:02:33, date: 2026-08-16 gitlab # [ 0.519314] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.521496] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.522157] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.524933] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.526105] audit: initializing netlink subsys (disabled) gitlab # [ 0.527156] audit: type=2000 audit(1786899754.702:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.527449] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.529094] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.530093] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.531093] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.532093] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.533109] cpuidle: using governor menu gitlab # [ 0.535328] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 gitlab # [ 0.536338] PCI: Using configuration type 1 for base access gitlab # [ 0.537094] PCI: Using configuration type 1 for extended access gitlab # [ 0.538246] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. gitlab # [ 0.540408] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.541985] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.542967] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.543985] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.547906] ACPI: Added _OSI(Module Device) gitlab # [ 0.548619] ACPI: Added _OSI(Processor Device) gitlab # [ 0.549095] ACPI: Added _OSI(Processor Aggregator Device) gitlab # [ 0.552074] ACPI: 1 ACPI AML tables successfully acquired and loaded gitlab # [ 0.556351] ACPI: Interpreter enabled gitlab # [ 0.557112] ACPI: PM: (supports S0 S3 S4 S5) gitlab # [ 0.557854] ACPI: Using IOAPIC for interrupt routing gitlab # [ 0.558131] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug gitlab # [ 0.559094] PCI: Using E820 reservations for host bridge windows gitlab # [ 0.560350] ACPI: Enabled 2 GPEs in block 00 to 0F gitlab # [ 0.565856] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) gitlab # [ 0.566957] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] gitlab # [ 0.568502] acpiphp: Slot [3] registered gitlab # [ 0.569136] acpiphp: Slot [4] registered gitlab # [ 0.569881] acpiphp: Slot [5] registered gitlab # [ 0.570115] acpiphp: Slot [6] registered gitlab # [ 0.570805] acpiphp: Slot [7] registered gitlab # [ 0.572126] acpiphp: Slot [8] registered gitlab # [ 0.572865] acpiphp: Slot [9] registered gitlab # [ 0.573115] acpiphp: Slot [10] registered gitlab # [ 0.573855] acpiphp: Slot [11] registered gitlab # [ 0.575137] acpiphp: Slot [12] registered gitlab # [ 0.575863] acpiphp: Slot [13] registered gitlab # [ 0.576114] acpiphp: Slot [14] registered gitlab # [ 0.576851] acpiphp: Slot [15] registered gitlab # [ 0.578116] acpiphp: Slot [16] registered gitlab # [ 0.578834] acpiphp: Slot [17] registered gitlab # [ 0.579113] acpiphp: Slot [18] registered gitlab # [ 0.579855] acpiphp: Slot [19] registered gitlab # [ 0.581115] acpiphp: Slot [20] registered gitlab # [ 0.581820] acpiphp: Slot [21] registered gitlab # [ 0.582114] acpiphp: Slot [22] registered gitlab # [ 0.582845] acpiphp: Slot [23] registered gitlab # [ 0.584115] acpiphp: Slot [24] registered gitlab # [ 0.584823] acpiphp: Slot [25] registered gitlab # [ 0.585113] acpiphp: Slot [26] registered gitlab # [ 0.585846] acpiphp: Slot [27] registered gitlab # [ 0.586114] acpiphp: Slot [28] registered gitlab # [ 0.586836] acpiphp: Slot [29] registered gitlab # [ 0.588184] acpiphp: Slot [30] registered gitlab # [ 0.588932] acpiphp: Slot [31] registered gitlab # [ 0.589602] PCI host bridge to bus 0000:00 gitlab # [ 0.590100] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] gitlab # [ 0.591093] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] gitlab # [ 0.592093] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] gitlab # [ 0.594094] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.595094] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.596094] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.597327] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.599612] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint gitlab # [ 0.601515] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint gitlab # [ 0.604122] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f] gitlab # [ 0.605007] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk gitlab # [ 0.605939] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk gitlab # [ 0.606840] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk gitlab # [ 0.608094] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk gitlab # [ 0.609256] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint gitlab # [ 0.612123] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f] gitlab # [ 0.614114] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint gitlab # [ 0.615365] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI gitlab # [ 0.617100] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB gitlab # [ 0.618336] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint gitlab # [ 0.633146] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] gitlab # [ 0.634106] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] gitlab # [ 0.635110] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref] gitlab # [ 0.636278] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] gitlab # [ 0.638887] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.643707] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f] gitlab # [ 0.645101] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] gitlab # [ 0.646082] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref] gitlab # [ 0.658059] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] gitlab # [ 0.660321] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.665126] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f] gitlab # [ 0.666045] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] gitlab # [ 0.666853] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref] gitlab # [ 0.669335] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.673221] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf] gitlab # [ 0.674721] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] gitlab # [ 0.676116] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref] gitlab # [ 0.678318] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.681079] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df] gitlab # [ 0.682699] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] gitlab # [ 0.683115] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref] gitlab # [ 0.686342] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.690127] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f] gitlab # [ 0.690966] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] gitlab # [ 0.691805] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref] gitlab # [ 0.694399] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.698102] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff] gitlab # [ 0.699055] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] gitlab # [ 0.699893] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref] gitlab # [ 0.702301] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.706355] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff] gitlab # [ 0.707740] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] gitlab # [ 0.709116] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref] gitlab # [ 0.710126] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref] gitlab # [ 0.712318] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.715106] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] gitlab # [ 0.716083] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref] gitlab # [ 0.718333] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.722101] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f] gitlab # [ 0.722971] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] gitlab # [ 0.723894] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref] gitlab # [ 0.726255] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.728896] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f] gitlab # [ 0.729771] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff] gitlab # [ 0.731115] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref] gitlab # [ 0.735832] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 gitlab # [ 0.737247] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 gitlab # [ 0.738281] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 gitlab # [ 0.739228] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 gitlab # [ 0.741170] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 gitlab # [ 0.743766] iommu: Default domain type: Translated gitlab # [ 0.743870] iommu: DMA domain TLB invalidation policy: lazy mode gitlab # [ 0.746833] ACPI: bus type USB registered gitlab # [ 0.747995] usbcore: registered new interface driver usbfs gitlab # [ 0.749112] usbcore: registered new interface driver hub gitlab # [ 0.751150] usbcore: registered new device driver usb gitlab # [ 0.754505] NetLabel: Initializing gitlab # [ 0.755095] NetLabel: domain hash size = 128 gitlab # [ 0.756027] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO gitlab # [ 0.757069] NetLabel: unlabeled traffic allowed by default gitlab # [ 0.757941] PCI: Using ACPI for IRQ routing gitlab # [ 0.760419] pci 0000:00:02.0: vgaarb: setting as boot VGA device gitlab # [ 0.761089] pci 0000:00:02.0: vgaarb: bridge control possible gitlab # [ 0.761089] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none gitlab # [ 0.764103] vgaarb: loaded gitlab # [ 0.765047] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 gitlab # [ 0.765805] hpet0: 3 comparators, 64-bit 100.000000 MHz counter gitlab # [ 0.770242] clocksource: Switched to clocksource kvm-clock gitlab # [ 0.772383] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.773279] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.775296] pnp: PnP ACPI init gitlab # [ 0.777088] pnp: PnP ACPI: found 6 devices gitlab # [ 0.788405] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns gitlab # [ 0.790279] clocksource: Switched to clocksource acpi_pm gitlab # [ 0.791567] NET: Registered PF_INET protocol family gitlab # [ 0.794206] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.814265] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.815710] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.817060] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.820775] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.822049] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.823488] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.824946] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.826302] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.827584] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.828474] NET: Registered PF_XDP protocol family gitlab # [ 0.829296] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] gitlab # [ 0.830260] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] gitlab # [ 0.831228] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] gitlab # [ 0.832284] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] gitlab # [ 0.833391] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window] gitlab # [ 0.834641] pci 0000:00:01.0: PIIX3: Enabling Passive Release gitlab # [ 0.835542] pci 0000:00:00.0: Limiting direct PCI/PCI transfers gitlab # [ 0.837903] ACPI: \_SB_.LNKD: Enabled at IRQ 11 gitlab # [ 0.840553] PCI: CLS 0 bytes, default 64 gitlab # [ 0.841336] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) gitlab # [ 0.841784] Trying to unpack rootfs image as initramfs... gitlab # [ 0.842342] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB) gitlab # [ 0.842468] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns gitlab # [ 0.865574] Initialise system trusted keyrings gitlab # [ 0.866769] workingset: timestamp_bits=40 max_order=21 bucket_order=0 gitlab # [ 0.878390] Key type asymmetric registered gitlab # [ 0.879087] Asymmetric key parser 'x509' registered gitlab # [ 0.879990] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) gitlab # [ 0.881737] io scheduler mq-deadline registered gitlab # [ 0.882490] io scheduler kyber registered gitlab # [ 0.885427] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.886713] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A gitlab # [ 0.889144] Linux agpgart interface v0.103 gitlab # [ 0.889916] ACPI: bus type drm_connector registered gitlab # [ 0.893182] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.894233] usbserial: USB Serial support registered for generic gitlab # [ 0.895184] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. gitlab # [ 0.895184] Please enable it if your BIOS has the CPPC option. gitlab # [ 0.897337] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled gitlab # [ 0.898667] drop_monitor: Initializing network drop monitor service gitlab # [ 0.899789] NET: Registered PF_INET6 protocol family gitlab # [ 0.901570] Segment Routing with IPv6 gitlab # [ 0.902214] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.904900] IPI shorthand broadcast: enabled gitlab # [ 0.909258] sched_clock: Marking stable (772011009, 136308889)->(928161826, -19841928) gitlab # [ 0.911102] registered taskstats version 1 gitlab # [ 0.912138] Loading compiled-in X.509 certificates gitlab # [ 0.922162] Demotion targets for Node 0: null gitlab # [ 0.923420] Key type .fscrypt registered gitlab # [ 0.924077] Key type fscrypt-provisioning registered gitlab # [ 0.925012] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.925894] ima: Allocated hash algorithm: sha1 gitlab # [ 0.926648] ima: No architecture policies found gitlab # [ 0.927672] PM: Magic number: 6:978:36 gitlab # [ 0.929249] RAS: Correctable Errors collector initialized. gitlab # [ 0.933745] clk: Disabling unused clocks gitlab # [ 0.934466] PM: genpd: Disabling unused power domains gitlab # [ 1.138993] Freeing initrd memory: 29392K gitlab # [ 1.143759] Freeing unused decrypted memory: 2028K gitlab # [ 1.146496] Freeing unused kernel image (initmem) memory: 3640K gitlab # [ 1.147554] Write protecting the kernel read-only data: 32768k gitlab # [ 1.149594] Freeing unused kernel image (text/rodata gap) memory: 1220K gitlab # [ 1.151217] Freeing unused kernel image (rodata/data gap) memory: 760K gitlab # [ 1.202614] x86/mm: Checked W+X mappings: passed, no W+X pages found. gitlab # [ 1.203678] Run /init as init process gitlab # [ 1.218608] systemd[1]: Inserted module 'autofs4' gitlab # [ 1.244923] fuse: init (API version 7.45) gitlab # [ 1.253198] ACPI: \_SB_.LNKC: Enabled at IRQ 10 gitlab # [ 1.260517] ACPI: \_SB_.LNKA: Enabled at IRQ 10 gitlab # [ 1.264105] ACPI: \_SB_.LNKB: Enabled at IRQ 11 gitlab # [ 1.300377] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.637005] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.678521] systemd[1]: Detected virtualization kvm. gitlab # [ 1.680623] systemd[1]: Detected architecture x86-64. gitlab # [ 1.682766] systemd[1]: Running in initrd. gitlab # [ 1.685203] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.688064] systemd[1]: Hostname set to . gitlab # [ 1.801534] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.840294] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.855884] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.857115] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.858530] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.859680] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.860772] systemd[1]: Reached target Path Units. gitlab # [ 1.861645] systemd[1]: Reached target Slice Units. gitlab # [ 1.862515] systemd[1]: Reached target Swaps. gitlab # [ 1.863328] systemd[1]: Reached target Timer Units. gitlab # [ 1.864279] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.865526] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.866668] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.867677] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.868676] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.869608] systemd[1]: Reached target Socket Units. gitlab # [ 1.871545] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.873543] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.875506] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 1.878914] systemd[1]: Starting Journal Service... gitlab # [ 1.892407] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.893411] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.902427] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.907328] systemd-journald[91]: Collecting audit messages is disabled. gitlab # [ 1.909825] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.917433] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 1.927544] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 1.936190] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config gitlab # [ 1.944687] netfs: FS-Cache loaded gitlab # [ 1.947546] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.956255] 9pnet: Installing 9P2000 support gitlab # [ 1.961350] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.964644] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.972682] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.974609] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.976641] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.978287] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.981537] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.845350] systemd-modules-load[93]: Using 4 probe threads gitlab # [ 1.847282] systemd-modules-load[93]: Inserted module 'virtio_balloon' gitlab # [ 1.848420] systemd-modules-load[93]: Inserted module 'dm_mod' gitlab # [ 1.849395] systemd-modules-load[93]: Inserted module 'virtio_gpu' gitlab # [ 1.989718] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.990934] systemd[1]: Started Journal Service. gitlab # [ 1.860523] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.865535] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.868112] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.869112] systemd[1]: Reached target Local File Systems. gitlab # [ 1.869872] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.872266] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.883664] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.894139] systemd-udevd[112]: Using default interface naming scheme 'v261'. gitlab # [ 1.904601] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.925637] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 1.926995] systemd[1]: Reached target System Initialization. gitlab # [ 1.928254] systemd[1]: Reached target Basic System. gitlab # [ 2.151245] uhci_hcd 0000:00:01.2: UHCI Host Controller gitlab # [ 2.152118] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 gitlab # [ 2.153762] uhci_hcd 0000:00:01.2: detected 2 ports gitlab # [ 2.155891] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140 gitlab # [ 2.158076] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 gitlab # [ 2.159280] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 gitlab # [ 2.160392] usb usb1: Product: UHCI Host Controller gitlab # [ 2.161061] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd gitlab # [ 2.161824] usb usb1: SerialNumber: 0000:00:01.2 gitlab # [ 2.163460] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 2.163531] hub 1-0:1.0: USB hub found gitlab # [ 2.165042] hub 1-0:1.0: 2 ports detected gitlab # [ 2.167627] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 2.171296] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 2.175203] virtio_blk virtio5: [vdb] 11830728 512-byte logical blocks (6.06 GB/5.64 GiB) gitlab # [ 2.182513] SCSI subsystem initialized gitlab # [ 2.210635] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 gitlab # [ 2.215034] serio: i8042 KBD port at 0x60,0x64 irq 1 gitlab # [ 2.215903] serio: i8042 AUX port at 0x60,0x64 irq 12 gitlab # [ 2.087807] (udev-worker)[122]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.089690] (udev-worker)[124]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.225909] scsi host0: ata_piix gitlab # [ 2.091785] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.234537] scsi host1: ata_piix gitlab # [ 2.235453] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0 gitlab # [ 2.236569] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0 gitlab # [ 2.102021] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.247237] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 gitlab # [ 2.118056] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.120615] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.121542] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.122315] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.123892] systemd-vconsole-setup[151]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.131663] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.147811] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.152525] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.387509] usb 1-1: new full-speed USB device number 2 using uhci_hcd gitlab # [ 2.403630] ata2: found unknown device (class 0) gitlab # [ 2.406222] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 gitlab # [ 2.410290] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 gitlab # [ 2.462833] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray gitlab # [ 2.489944] cdrom: Uniform CD-ROM driver Revision: 3.20 gitlab # [ 2.556234] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 gitlab # [ 2.557450] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 gitlab # [ 2.558438] usb 1-1: Product: QEMU USB Tablet gitlab # [ 2.559025] usb 1-1: Manufacturer: QEMU gitlab # [ 2.559583] usb 1-1: SerialNumber: 28754-0000:00:01.2-1 gitlab # [ 2.575153] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 2.582762] usbcore: registered new interface driver usbhid gitlab # [ 2.583902] usbhid: USB HID core driver gitlab # [ 2.589833] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 gitlab # [ 2.592336] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0 gitlab # [ 2.770917] systemd[1]: Mounting /sysroot... gitlab # [ 3.053792] EXT4-fs (vda): mounted filesystem 10882c1f-d19a-414d-bab8-6c52fec2d85f r/w with ordered data mode. Quota mode: none. gitlab # [ 2.920634] systemd[1]: Mounted /sysroot. gitlab # [ 2.921351] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.923312] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.925115] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.926668] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.927947] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.934106] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.935792] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.942096] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.082457] 9p: Installing v9fs 9p2000 file system support gitlab # [ 2.947421] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.949338] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.088063] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.952139] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.954589] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.955720] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.956729] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.958158] systemd[1]: Reloading... gitlab # [ 3.011840] systemd[1]: Reloading finished in 54 ms. gitlab # [ 3.032290] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.034316] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace... gitlab # [ 3.035633] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.036418] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.037265] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.038119] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.049655] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.050739] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.770776] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.814619] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.816927] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.820360] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.823303] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.837726] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.839675] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.850969] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.852120] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.853533] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.885681] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.886716] systemd[1]: Stopped target Basic System. gitlab # [ 3.887559] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.888398] systemd[1]: Stopped target Path Units. gitlab # [ 3.889208] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.890428] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.891642] systemd[1]: Stopped target Slice Units. gitlab # [ 3.893383] systemd[1]: Stopped target Socket Units. gitlab # [ 3.894755] systemd[1]: Stopped target System Initialization. gitlab # [ 3.896403] systemd[1]: Stopped target Swaps. gitlab # [ 3.897268] systemd[1]: Stopped target Timer Units. gitlab # [ 3.898210] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.899097] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.899897] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.900974] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.901765] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 3.903261] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.904090] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.904942] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.905684] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.906645] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.907349] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.908431] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.909592] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.910564] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.911376] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.912196] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.913163] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.914112] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.914845] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.915812] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.916793] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.917512] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.918403] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.919266] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.920218] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.921279] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.922171] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.923167] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.924139] systemd[1]: Closed udev Control Socket. gitlab # [ 3.924856] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.925761] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.926838] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.927733] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.928764] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.929701] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.930629] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.935209] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.936359] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.937132] systemd[1]: Reached target Switch Root. gitlab # [ 3.937960] systemd[1]: Starting NixOS Activation... gitlab # [ 4.041658] initrd-nixos-activation-start[225]: booting system configuration /nix/store/y7c8gk2v0hms0dmaacj4qqb9msxj3wv8-nixos-system-gitlab-test gitlab # [ 4.081121] initrd-nixos-activation-start[225]: running activation script... gitlab # [ 4.252192] initrd-nixos-activation-start[248]: setting up /etc... gitlab # [ 4.324110] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.325988] systemd[1]: Finished NixOS Activation. gitlab # [ 4.327324] systemd[1]: Starting Switch Root... gitlab # [ 4.344518] systemd[1]: Switching root. gitlab # [ 4.528143] systemd-journald[91]: Received SIGTERM from PID 1 (systemd). gitlab # [ 4.612785] NET: Registered PF_VSOCK protocol family gitlab # [ 4.980852] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 4.989604] systemd[1]: Detected virtualization kvm. gitlab # [ 4.991368] systemd[1]: Detected architecture x86-64. gitlab # [ 4.993220] systemd[1]: Detected first boot. gitlab # [ 4.995618] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.116024] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.171378] systemd[1]: Applying preset policy. gitlab # [ 5.273697] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 5.382877] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 5.384199] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 5.386161] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 5.388580] systemd[1]: Created slice Slice /system/getty. gitlab # [ 5.389886] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 5.391269] systemd[1]: Created slice User and Session Slice. gitlab # [ 5.392161] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 5.393439] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 5.394481] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 5.395158] systemd[1]: Expecting device /dev/ttyS0... gitlab # [ 5.395883] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 5.396693] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 5.397427] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 5.398191] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 5.399026] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 5.399924] systemd[1]: Reached target Path Units. gitlab # [ 5.400642] systemd[1]: Reached target Remote File Systems. gitlab # [ 5.401406] systemd[1]: Reached target Slice Units. gitlab # [ 5.402077] systemd[1]: Reached target Swaps. gitlab # [ 5.403550] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 5.405483] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 5.406900] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 5.408505] systemd[1]: Listening on Factory Reset Management. gitlab # [ 5.409421] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 5.411875] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 5.413328] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 5.415347] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 5.416448] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 5.417549] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.418830] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 5.421701] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 5.422933] systemd[1]: Listening on udev Control Socket. gitlab # [ 5.423797] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 5.426146] systemd[1]: Mounting Huge Pages File System... gitlab # [ 5.427962] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 5.429945] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 5.432285] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 5.434924] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 5.436275] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio gitlab # [ 5.443481] systemd[1]: Starting Load Kernel Module configfs... gitlab # [ 5.444599] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 5.446397] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.448395] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.466073] systemd[1]: Mounting FUSE Control File System... gitlab # [ 5.467044] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.470897] systemd[1]: Starting Journal Service... gitlab # [ 5.473268] systemd[1]: Starting Load Kernel Modules... gitlab # [ 5.478395] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 5.483401] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 5.484624] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.487526] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 5.490933] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 5.492204] systemd[1]: Mounted Huge Pages File System. gitlab # [ 5.493435] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 5.495468] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 5.496858] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 5.496971] systemd-journald[318]: Collecting audit messages is enabled. gitlab # [ 5.499089] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 5.500697] systemd[1]: modprobe@configfs.service: Deactivated successfully. gitlab # [ 5.504366] systemd[1]: Finished Load Kernel Module configfs. gitlab # [ 5.505533] systemd[1]: Mounted FUSE Control File System. gitlab # [ 5.508369] EXT4-fs (vda): re-mounted 10882c1f-d19a-414d-bab8-6c52fec2d85f. gitlab # [ 5.513455] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 5.379712] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 5.381837] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 5.518900] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 5.384308] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 5.385614] systemd-modules-load[319]: Using 3 probe threads[ 5.522073] systemd[1]: Started Journal Service. gitlab # gitlab # [ 5.387067] systemd-modules-load[319]: Inserted module 'tls' gitlab # [ 5.388092] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 5.530567] loop: module loaded gitlab # [ 5.395080] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 5.396252] systemd-modules-load[319]: Inserted module 'loop' gitlab # [ 5.398924] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 5.400556] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 5.401398] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.402887] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 5.403663] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.404951] systemd-oomd[321]: No swap; memory pressure usage will be degraded gitlab # [ 5.407837] systemd[1]: Finished Load Kernel Modules. gitlab # [ 5.409227] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 5.410052] systemd[1]: Starting Firewall... gitlab # [ 5.410966] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 5.415078] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 5.553454] systemd-journald[318]: Received client request to flush runtime journal. gitlab # [ 5.463387] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 5.464540] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 5.465396] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 5.466223] systemd[1]: Reached target First Boot Complete. gitlab # [ 5.466979] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 5.467889] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 5.468854] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 5.470031] systemd-udevd[350]: Using default interface naming scheme 'v261'. gitlab # [ 5.470951] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 5.499700] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 5.516663] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 5.569627] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse gitlab # [ 5.589362] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 5.651183] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. gitlab # [ 5.653053] (udev-worker)[422]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 5.655410] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 5.657626] (udev-worker)[431]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 5.830244] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3 gitlab # [ 5.843745] ACPI: button: Power Button [PWRF] gitlab # [ 5.853033] rtc_cmos 00:05: RTC can wake from S4 gitlab # [ 5.853495] parport_pc 00:03: reported by Plug and Play ACPI gitlab # [ 5.855620] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] gitlab # [ 5.858478] rtc_cmos 00:05: registered as rtc0 gitlab # [ 5.859252] rtc_cmos 00:05: setting system clock to 2026-08-16T17:02:39 UTC (1786899759) gitlab # [ 5.863252] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs gitlab # [ 5.873357] Floppy drive(s): fd0 is 2.88M AMI BIOS gitlab # [ 5.876776] systemd-journald[318]: Time jumped backwards, rotating. gitlab # [ 5.881201] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console gitlab # [ 5.890459] FDC 0 is a S82078B gitlab # [ 5.893250] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 gitlab # [ 5.893993] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD gitlab # [ 5.894448] Console: switching to colour dummy device 80x25 gitlab # [ 5.896992] [drm] Found bochs VGA, ID 0xb0c5. gitlab # [ 5.896994] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. gitlab # [ 5.898890] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic gitlab # [ 5.899749] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0 gitlab # [ 5.772388] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 5.773874] systemd[1]: Finished Firewall. gitlab # [ 5.910779] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 gitlab # [ 5.911066] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 gitlab # [ 5.912010] Console: switching to colour frame buffer device 160x50 gitlab # [ 5.916679] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device gitlab # [ 5.782354] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 5.787429] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 5.790466] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 5.791953] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.793800] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 5.931686] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6 gitlab # [ 5.947617] mousedev: PS/2 mouse device common for all mice gitlab # [ 5.850406] systemd[1]: Starting Virtual Console Setup... gitlab # [ 5.867447] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 5.868837] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 5.873450] systemd[1]: Starting Virtual Console Setup... gitlab # [ 5.885098] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 5.886734] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 5.893413] systemd[1]: Starting Virtual Console Setup... gitlab # [ 6.055323] ppdev: user-space parallel port driver gitlab # [ 6.076824] kvm_amd: TSC scaling supported gitlab # [ 6.077471] kvm_amd: Nested Virtualization enabled gitlab # [ 6.078042] kvm_amd: Nested Paging enabled gitlab # [ 6.078583] kvm_amd: LBR virtualization supported gitlab # [ 6.079232] kvm_amd: Virtual VMLOAD VMSAVE supported gitlab # [ 6.079853] kvm_amd: Virtual GIF supported gitlab # [ 6.080450] kvm_amd: Virtual NMI enabled gitlab # [ 5.978350] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 5.980881] systemd[1]: Finished Virtual Console Setup. gitlab # [ 6.189064] EDAC MC: Ver: 3.0.0 gitlab # [ 6.248704] systemd[1]: Mounting /run/wrappers... gitlab # [ 6.267843] systemd[1]: Mounted /run/wrappers. gitlab # [ 6.268669] systemd[1]: Reached target Local File Systems. gitlab # [ 6.269428] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 6.270521] systemd[1]: Starting register-nix-paths.service... gitlab # [ 6.271506] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 6.272295] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 6.273442] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 6.277734] systemd[1]: Starting Create System Files and Directories... gitlab # [ 6.295842] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 6.296886] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 6.297968] systemd[1]: Finished Create System Files and Directories. gitlab # [ 6.302091] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 6.303717] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 6.317573] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 6.328735] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 6.330176] systemd[1]: Starting Update is Completed... gitlab # [ 6.344219] systemd[1]: Finished Update is Completed. gitlab # [ 6.365419] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 6.366589] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 6.592512] systemd[1]: Finished register-nix-paths.service. gitlab # [ 6.595856] systemd[1]: Reached target System Initialization. gitlab # [ 6.598524] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 6.601418] systemd[1]: Started logrotate.timer. gitlab # [ 6.603340] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 6.605847] systemd[1]: Reached target Timer Units. gitlab # [ 6.607766] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 6.610234] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 6.620469] systemd[1]: Starting nixbot CI service socket... gitlab # [ 6.622654] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 6.625690] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 6.628749] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 6.630956] systemd[1]: Reached target Socket Units. gitlab # [ 6.674479] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 6.677486] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync' gitlab # [ 6.680035] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 6.685547] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 6.695876] dbus-broker-launch[576]: Ready gitlab # [ 6.698938] systemd[1]: Reached target Basic System. gitlab # [ 6.701409] systemd[1]: Started backdoor.service. gitlab # [ 6.704299] systemd[1]: Starting gitlab-config.service... gitlab # [ 6.717197] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 6.719576] systemd[1]: Starting Logrotate configuration check... gitlab # [ 6.721648] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 6.729228] systemd[1]: Starting Post-Boot Actions... gitlab # [ 6.731510] systemd[1]: Started Reset console on configuration changes. gitlab # [ 6.736543] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 6.741123] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf gitlab # [ 6.744070] logrotate[581]: note: 'monthly' overrides previously specified 'weekly' gitlab # connecting to host... gitlab # [ 6.747652] logrotate[581]: Reading state from file: /var/lib/logrotate.status gitlab # [ 6.748678] logrotate[581]: state file /var/lib/logrotate.status does not exist gitlab # [ 6.749522] logrotate[581]: Allocating hash table for state file, size 64 entries gitlab # [ 6.749833] logrotate[581]: Handling 4 logs gitlab # [ 6.750637] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 6.751488] logrotate[581]: considering log /var/log/btmp gitlab # [ 6.752333] logrotate[581]: Creating new state gitlab # [ 6.752944] logrotate[581]: Now: 2026-08-16 17:02 gitlab # [ 6.753771] logrotate[581]: Last rotated at 2026-08-16 17:00 gitlab # [ 6.755109] logrotate[581]: log does not need rotating (log has already been rotated) gitlab # [ 6.755696] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 6.756056] logrotate[581]: considering log /var/log/wtmp gitlab # [ 6.756580] logrotate[581]: Creating new state gitlab # [ 6.757180] logrotate[581]: Now: 2026-08-16 17:02 gitlab # [ 6.757739] logrotate[581]: Last rotated at 2026-08-16 17:00 gitlab # [ 6.758405] logrotate[581]: log does not need rotating (log has already been rotated) gitlab # [ 6.758893] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 6.759724] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581) gitlab # [ 6.760571] logrotate[581]: considering log /var/gitlab/state/log/*.log gitlab # [ 6.761391] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 6.761953] logrotate[581]: Creating new state gitlab # [ 6.762779] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581) gitlab # [ 6.763668] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 6.764480] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581) gitlab # [ 6.765041] logrotate[581]: considering log /var/log/nginx/*.log gitlab # [ 6.765852] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 6.766667] logrotate[581]: Creating new state gitlab # [ 6.767747] logrotate[581]: not running postrotate script, since no logs were rotated gitlab # [ 6.768430] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581) gitlab # [ 6.768915] systemd[1]: Starting resolvconf update... gitlab # [ 6.769580] systemd[1]: Finished Logrotate configuration check. gitlab # [ 6.770145] systemd[1]: Finished Post-Boot Actions. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab: connected to guest root shell gitlab # [ 6.800391] nsncd[582]: Aug 16 17:02:40.576 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab: (connecting took 7.39 seconds) gitlab: (finished: waiting for the VM to finish booting, in 7.39 seconds) gitlab # [ 6.801149] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 6.803941] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 6.804608] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 6.809095] systemd[1]: Starting User Login Management... gitlab # [ 6.810894] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 6.835453] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 6.836420] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 6.837220] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 6.838076] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 6.838901] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 6.839995] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 6.840782] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 6.841839] systemd[1]: nscd.service: Consumed 16ms CPU time over 121ms wall clock time, 7.1M memory peak, 5.5M read from disk. gitlab # [ 6.843740] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 6.847359] systemd-logind[629]: New seat seat0. gitlab # [ 6.851551] systemd-logind[629]: Watching system buttons on /dev/input/event2 (Power Button) gitlab # [ 6.852194] systemd-logind[629]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard) gitlab # [ 6.852714] systemd-logind[629]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) gitlab # [ 6.853162] systemd[1]: Started User Login Management. gitlab # [ 6.856299] systemd[1]: Starting linger-users.service... gitlab # [ 6.863609] nsncd[670]: Aug 16 17:02:40.639 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 6.865942] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 6.867172] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 6.868370] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 6.872483] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 6.873349] systemd[1]: Finished linger-users.service. gitlab # [ 6.876589] systemd[1]: Finished resolvconf update. gitlab # [ 6.877414] systemd[1]: Reached target Preparation for Network. gitlab # [ 6.880161] systemd[1]: Starting DHCP Client... gitlab # [ 6.882263] systemd[1]: Starting Address configuration of eth1... gitlab # [ 6.885297] systemd[1]: Starting Extra networking commands.... gitlab # [ 6.916314] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done gitlab # [ 6.918190] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done gitlab # [ 6.922394] systemd[1]: Finished Address configuration of eth1. gitlab # [ 6.942992] systemd[1]: Finished Extra networking commands.. gitlab # [ 6.945090] systemd[1]: Reached target Network. gitlab # [ 6.946463] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 6.949256] systemd[1]: Starting Nginx Web Server... gitlab # [ 6.952294] dhcpcd[705]: dhcpcd-10.3.2 starting gitlab # [ 6.953365] systemd[1]: Starting PostgreSQL Server... gitlab # [ 6.954964] dhcpcd[767]: dev: loaded udev gitlab # [ 6.957070] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 6.958178] systemd[1]: Starting Permit User Sessions... gitlab # [ 7.097951] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 7.098640] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 6.973395] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 6.975789] systemd[1]: Finished Permit User Sessions. gitlab # [ 6.979351] systemd[1]: Started Getty on tty1. gitlab # [ 6.980961] systemd[1]: Reached target Login Prompts. gitlab # [ 7.185642] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 7.190207] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 7.191139] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 7.192532] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 7.193566] cfg80211: failed to load regulatory.db gitlab # [ 7.077762] nginx-pre-start[791]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok gitlab # [ 7.081192] nginx-pre-start[791]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful gitlab # [ 7.081795] systemd[1]: Started Nginx Web Server. gitlab # [ 7.220486] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 7.085301] dhcpcd[767]: eth0: waiting for carrier gitlab # [ 7.086366] dhcpcd[767]: eth0: carrier acquired gitlab # [ 7.092869] dhcpcd[767]: DUID 00:01:00:01:32:14:a9:b0:52:54:00:12:34:56 gitlab # [ 7.093931] dhcpcd[767]: eth0: IAID 00:12:34:56 gitlab # [ 7.094962] dhcpcd[767]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 7.098318] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 7.100328] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 7.101469] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 7.102345] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started gitlab # [ 7.103705] redis-server[788]: Configuration loaded gitlab # [ 7.104566] redis[788]: monotonic clock: POSIX clock_gettime gitlab # [ 7.105455] redis[788]: Running mode=standalone, port=0. gitlab # [ 7.106402] redis[788]: Server initialized gitlab # [ 7.107220] redis[788]: Ready to accept connections unix gitlab # [ 7.108085] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 7.110266] postgresql-pre-start[790]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 7.110888] postgresql-pre-start[790]: This user must also own the server process. gitlab # [ 7.116636] postgresql-pre-start[790]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 7.117542] postgresql-pre-start[790]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 7.120308] postgresql-pre-start[790]: The default text search configuration will be set to "english". gitlab # [ 7.121692] postgresql-pre-start[790]: Data page checksums are enabled. gitlab # [ 7.123617] postgresql-pre-start[790]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 7.125066] postgresql-pre-start[790]: creating subdirectories ... ok gitlab # [ 7.125924] postgresql-pre-start[790]: selecting dynamic shared memory implementation ... posix gitlab # [ 7.145238] postgresql-pre-start[790]: selecting default "max_connections" ... 100 gitlab # [ 7.194666] postgresql-pre-start[790]: selecting default "shared_buffers" ... 128MB gitlab # [ 7.403071] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 7.542105] postgresql-pre-start[790]: selecting default time zone ... UTC gitlab # [ 7.543816] postgresql-pre-start[790]: creating configuration files ... ok gitlab # [ 7.575987] gitlab-workhorse[824]: time="2026-08-16T17:02:41Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 7.577969] gitlab-workhorse[824]: time="2026-08-16T17:02:41Z" level=info msg="Using redis/go-redis" gitlab # [ 7.581295] gitlab-workhorse[824]: time="2026-08-16T17:02:41Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 7.711618] postgresql-pre-start[790]: running bootstrap script ... ok gitlab # [ 8.118847] postgresql-pre-start[790]: performing post-bootstrap initialization ... ok gitlab # [ 8.275771] dhcpcd[767]: eth0: soliciting an IPv6 router gitlab # [ 8.277426] dhcpcd[767]: eth0: Router Advertisement from fe80::2 gitlab # [ 8.278113] dhcpcd[767]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 8.278589] dhcpcd[767]: eth0: adding route to fec0::/64 gitlab # [ 8.279184] dhcpcd[767]: eth0: adding default route via fe80::2 gitlab # [ 8.325921] postgresql-pre-start[790]: syncing data to disk ... ok gitlab # [ 8.327955] postgresql-pre-start[790]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 8.330839] postgresql-pre-start[790]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 8.335691] postgresql-pre-start[790]: Success. You can now start the database server using: gitlab # [ 8.338318] postgresql-pre-start[790]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 8.407870] postgres[848]: [848] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 8.412526] postgres[848]: [848] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 8.415151] postgres[848]: [848] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 8.417934] postgres[848]: [848] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 8.423200] postgres[858]: [858] LOG: database system was shut down at 2026-08-16 17:02:41 GMT gitlab # [ 8.431729] postgres[848]: [848] LOG: database system is ready to accept connections gitlab # [ 8.435688] systemd[1]: Started PostgreSQL Server. gitlab # [ 8.439261] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 8.589686] postgresql-setup-start[869]: CREATE DATABASE gitlab # [ 8.616269] postgresql-setup-start[879]: CREATE ROLE gitlab # [ 8.619624] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[874]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 8.620785] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[874]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 8.624578] postgresql-setup-start[881]: ALTER DATABASE gitlab # [ 8.639925] postgresql-setup-start[891]: CREATE ROLE gitlab # [ 8.641506] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 8.642241] systemd[1]: Reached target PostgreSQL. gitlab # [ 8.643366] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 8.658270] systemd[1]: Finished gitlab-config.service. gitlab # [ 8.661360] systemd[1]: Started gitaly.service. gitlab # [ 8.663798] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 8.716506] dhcpcd[767]: eth0: soliciting a DHCP lease gitlab # [ 8.857781] NET: Registered PF_PACKET protocol family gitlab # [ 8.728428] dhcpcd[767]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.734637] dhcpcd[767]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.737118] gitlab-postgresql-start[909]: CREATE DATABASE gitlab # [ 8.770103] gitlab-postgresql-start[916]: CREATE EXTENSION gitlab # [ 8.855907] gitlab-postgresql-start[919]: CREATE EXTENSION gitlab # [ 8.859309] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 9.147352] gitaly[902]: time="2026-08-16T17:02:42.923Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=902 gitlab # [ 9.148110] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=902 gitlab # [ 9.148621] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=902 gitlab # [ 9.149194] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=902 gitlab # [ 9.149561] gitaly[902]: time="2026-08-16T17:02:42.924Z" level=info msg="Starting Gitaly" pid=902 version= gitlab # [ 9.339522] gitaly[902]: time="2026-08-16T17:02:43.116Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=179 pid=902 gitlab # [ 9.341046] gitaly[902]: time="2026-08-16T17:02:43.117Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=902 gitlab # [ 9.341725] gitaly[902]: time="2026-08-16T17:02:43.118Z" level=info msg="finished initializing command factory" duration_ms=0 pid=902 gitlab # [ 9.342297] gitaly[902]: time="2026-08-16T17:02:43.118Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-902/git-exec-1375085874.d/git pid=902 gitlab # [ 9.347576] gitaly[902]: time="2026-08-16T17:02:43.124Z" level=info msg="finished detecting git version" duration_ms=6 pid=902 gitlab # [ 9.348104] gitaly[902]: time="2026-08-16T17:02:43.124Z" level=info msg="using Git version" pid=902 version=2.53.g gitlab # [ 9.348588] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="clearing disk cache object folder" pid=902 storage=default gitlab # [ 9.349052] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1612199132 pid=902 storage=default gitlab # [ 9.349555] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1612199132 pid=902 storage=default gitlab # [ 9.350375] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=902 gitlab # [ 9.351128] gitaly[902]: time="2026-08-16T17:02:43.125Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=902 gitlab # [ 9.351844] gitaly[902]: time="2026-08-16T17:02:43.127Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1612199132 clear_duration_ms=0 pid=902 storage=default gitlab # [ 9.395591] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=902 gitlab # [ 9.396222] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="counting repositories" pid=902 gitlab # [ 9.396588] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=902 schema=unix gitlab # [ 9.396989] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="starting to count repositories" pid=902 storage_path=/var/gitlab/state/repositories gitlab # [ 9.397549] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="listening at address" address=/run/gitaly/gitaly-902/sock.d/intern pid=902 schema=unix gitlab # [ 9.399094] gitaly[902]: time="2026-08-16T17:02:43.172Z" level=info msg="finished tempdir cleaner walk" pid=902 storage=default time_ms=0 gitlab # [ 9.405263] gitaly[902]: time="2026-08-16T17:02:43.182Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=902 storage_path=/var/gitlab/state/repositories gitlab # [ 9.407590] gitaly[902]: time="2026-08-16T17:02:43.182Z" level=info msg="completed counting all repositories" counting_duration=9 pid=902 gitlab # [ 9.409361] gitaly[902]: time="2026-08-16T17:02:43.183Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=902 gitlab # [ 9.411124] gitaly[902]: time="2026-08-16T17:02:43.183Z" level=info msg="Started Gitaly" duration_ms=259 pid=902 gitlab # [ 9.412536] gitaly[902]: time="2026-08-16T17:02:43.184Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=902 gitlab # [ 9.414178] gitaly[902]: time="2026-08-16T17:02:43.184Z" level=info msg="maintenance: daily scheduled" pid=902 scheduled="2026-08-17 12:00:00 +0000 UTC" gitlab # [ 9.709856] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 9.710579] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 9.728648] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 11.532531] gitaly[902]: time="2026-08-16T17:02:45.309Z" level=info msg="License database preloaded" duration_ms=2384 pid=902 gitlab # [ 14.137679] dhcpcd[767]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 14.139150] dhcpcd[767]: eth0: adding route to 10.0.2.0/24 gitlab # [ 14.140185] dhcpcd[767]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.247057] systemd[1]: Started DHCP Client. gitlab # [ 14.249125] systemd[1]: Reached target Network is Online. gitlab # [ 43.014743] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[910]: W, [2026-08-16T17:03:16.791105 #910] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 45.144985] postgres[1335]: [1335] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 45.145515] postgres[1335]: [1335] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 45.146852] postgres[1335]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 45.148622] postgres[1335]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 45.150446] postgres[1335]: attidentity AS identity, gitlab # [ 45.151530] postgres[1335]: attgenerated as attgenerated gitlab # [ 45.153401] postgres[1335]: FROM pg_attribute a gitlab # [ 45.155281] postgres[1335]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 45.155652] postgres[1335]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 45.157412] postgres[1335]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 45.159154] postgres[1335]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 45.160533] postgres[1335]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 45.162306] postgres[1335]: ORDER BY a.attnum gitlab # [ 45.164065] postgres[1335]: gitlab # [ 47.634594] gitlab-workhorse[824]: time="2026-08-16T17:03:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 48.715687] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1377]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 48.716232] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1377]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 57.645200] gitlab-workhorse[824]: time="2026-08-16T17:03:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 63.552550] postgres[1443]: [1443] ERROR: relation "table_without_models" does not exist gitlab # [ 63.553858] postgres[1443]: [1443] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 67.654344] gitlab-workhorse[824]: time="2026-08-16T17:03:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 75.095079] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 75.100623] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 75.105649] systemd[1]: Starting gitlab.service... gitlab # [ 75.456648] bundle[1610]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 75.461243] bundle[1610]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 75.465587] bundle[1610]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 77.666911] gitlab-workhorse[824]: time="2026-08-16T17:03:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 78.249514] sidekiq-cluster[1609]: {"severity":"INFO","time":"2026-08-16T17:03:52.008Z","message":"Starting cluster with 1 processes"} gitlab # [ 78.380169] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.131Z","pid":1610,"message":"* Enabling systemd notification integration"} gitlab # [ 78.383813] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"Puma starting in cluster mode..."} gitlab # [ 78.387378] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 78.390881] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 78.395068] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Min threads: 0"} gitlab # [ 78.397864] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Max threads: 4"} gitlab # [ 78.400723] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Environment: production"} gitlab # [ 78.403691] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Master PID: 1610"} gitlab # [ 78.406579] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Workers: 2"} gitlab # [ 78.409342] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 78.412888] bundle[1610]: {"timestamp":"2026-08-16T17:03:52.156Z","pid":1610,"message":"* Preloading application"} gitlab # [ 87.666741] gitlab-workhorse[824]: time="2026-08-16T17:04:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 97.667534] gitlab-workhorse[824]: time="2026-08-16T17:04:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 103.234946] bundle[1610]: W, [2026-08-16T17:04:17.011277 #1610] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 105.499399] sidekiq-cluster[1640]: 2026-08-16T17:04:19.275Z pid=1640 tid=wjk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1640, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433160192} gitlab # [ 105.675174] sidekiq-cluster[1640]: W, [2026-08-16T17:04:19.451895 #1640] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 105.715797] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:19.492Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 107.677868] gitlab-workhorse[824]: time="2026-08-16T17:04:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 107.781612] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.557Z","message":"GitLab reliable fetch activated!"} gitlab # [ 107.785288] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.557Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 107.805633] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.582Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 107.810646] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.586Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 107.814149] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.591Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 107.818208] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.595Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 107.822697] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.599Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 107.828223] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.605Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 107.831764] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.608Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 107.835515] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.612Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 107.839233] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.616Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 107.842638] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.619Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 107.846405] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.623Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 107.851274] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.628Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 107.855044] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.631Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 107.858669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.635Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 107.862600] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.639Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 107.866564] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.643Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 107.870425] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.647Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 107.874726] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.651Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 107.879034] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.655Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 107.883045] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.659Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 107.887231] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.664Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 107.890493] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.667Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 107.892790] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.669Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 107.895366] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.672Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 107.897751] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.674Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 107.900512] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.677Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 107.903050] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.680Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 107.905539] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.682Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 107.907931] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.684Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 107.910475] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.687Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 107.912726] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.689Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 107.915111] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.692Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 107.917547] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.694Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 107.920102] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.697Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 107.922485] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.699Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 107.924782] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.701Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 107.926840] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.703Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 107.929163] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.706Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 107.931235] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.708Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 107.933289] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.710Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 107.935523] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.712Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 107.937344] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.714Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 107.939559] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.716Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 107.941820] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.718Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 107.944411] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.721Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 107.946467] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.723Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 107.948452] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.725Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 107.950712] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.727Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 107.953225] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.730Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 107.955453] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.732Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 107.957771] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.734Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 107.960295] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.737Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 107.968515] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.745Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 107.971370] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.748Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 107.975404] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.752Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 107.980659] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.757Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 107.986802] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.763Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 107.989961] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.766Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 107.991880] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.768Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 107.994642] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.771Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 107.998294] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.775Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 108.003929] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.780Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 108.008073] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.784Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 108.012654] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.789Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 108.017128] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.794Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 108.021189] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.798Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 108.025615] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.802Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 108.027669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.804Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 108.073273] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.850Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 108.075847] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.851Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 108.076868] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.853Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 108.079158] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.856Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 108.081967] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.858Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 108.084250] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.861Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 108.087360] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.863Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 108.089951] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.866Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 108.092574] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.869Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 108.095802] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.872Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 108.098321] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.875Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 108.101324] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.878Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 108.103841] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.880Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 108.106657] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.883Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 108.109306] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.886Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 108.111853] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.888Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 108.113979] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.890Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 108.116466] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.893Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 108.118847] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.895Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 108.121391] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.898Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 108.123401] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.900Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 108.126040] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.903Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 108.128048] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.905Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 108.130021] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.906Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 108.132350] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.909Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 108.134378] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.911Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 108.137206] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.914Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 108.139681] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.916Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 108.142046] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.919Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 108.143979] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.920Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 108.152718] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.929Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 108.154900] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.931Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 108.156878] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.933Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 108.160149] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.937Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 108.163116] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.940Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 108.165489] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.942Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 108.169391] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.946Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 108.171448] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.948Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 108.173957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.950Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 108.176761] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.953Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 108.179400] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:21.956Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 117.678540] gitlab-workhorse[824]: time="2026-08-16T17:04:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 127.688881] gitlab-workhorse[824]: time="2026-08-16T17:04:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 130.112183] postgres[2123]: [2123] ERROR: relation "table_without_models" does not exist gitlab # [ 130.113316] postgres[2123]: [2123] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 132.104356] postgres[2144]: [2144] ERROR: relation "table_without_models" does not exist gitlab # [ 132.105560] postgres[2144]: [2144] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 132.616909] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.393Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 132.622987] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.399Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 132.623670] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.399Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 132.624782] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.399Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 132.636580] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:46.413Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 134.225283] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:48.001Z","message":"Cleaning working queues"} gitlab # [ 134.228921] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:48.002Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"34997d9b6c386f7b7cb19bad","created_at":"2026-08-16T17:03:48.472Z","trace_propagation_headers":{"sentry-trace":"e243c2a7f2454993b4428cf7fd7c3983-dd55058a4af140f1","baggage":"sentry-trace_id=e243c2a7f2454993b4428cf7fd7c3983,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1475b34960df00b9762a856de3597b5d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:48.480Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-34997d9b6c386f7b7cb19bad: start","job_status":"start","queue_duration_s":59.521828,"scheduling_latency_s":59.521888} gitlab # [ 134.385885] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:04:48.162Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"34997d9b6c386f7b7cb19bad","created_at":"2026-08-16T17:03:48.472Z","trace_propagation_headers":{"sentry-trace":"e243c2a7f2454993b4428cf7fd7c3983-dd55058a4af140f1","baggage":"sentry-trace_id=e243c2a7f2454993b4428cf7fd7c3983,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1475b34960df00b9762a856de3597b5d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:48.480Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-34997d9b6c386f7b7cb19bad: done: 0.159831 sec","job_status":"done","queue_duration_s":59.521828,"scheduling_latency_s":59.521888,"redis_calls":31,"redis_duration_s":0.006943,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004014,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001761,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.078867566,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.159831,"completed_at":"2026-08-16T17:04:48.162Z","load_balancing_strategy":"primary","db_duration_s":0.042564,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 134.974069] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 134.975533] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 134.976850] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"! #\u003cThread:0x00007ca6d1bdd428 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 134.978238] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"! #\u003cThread:0x00007ca6d1e42768 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 134.979361] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"Use Ctrl-C to stop"} gitlab # [ 134.980349] bundle[1610]: {"timestamp":"2026-08-16T17:04:48.750Z","pid":1610,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 135.319756] bundle[1610]: {"timestamp":"2026-08-16T17:04:49.096Z","pid":1610,"message":"- Worker 0 (PID: 2198) booted in 0.29s, phase: 0"} gitlab # [ 135.351623] bundle[1610]: {"timestamp":"2026-08-16T17:04:49.128Z","pid":1610,"message":"- Worker 1 (PID: 2206) booted in 0.3s, phase: 0"} gitlab # [ 135.357729] systemd[1]: Started gitlab.service. gitlab # [ 135.359454] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 135.361662] systemd[1]: Starting setup-gitlab.service... gitlab # [ 135.380866] setup-gitlab-start[2235]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 137.858755] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:04:51 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 2448 gitlab # [ 137.864672] setup-gitlab-start[2235]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 137.865803] setup-gitlab-start[2235]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 137.875518] runuser[2257]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 138.240967] setup-gitlab-start[2258]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 138.242662] setup-gitlab-start[2258]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 138.243933] setup-gitlab-start[2258]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 138.819693] setup-gitlab-start[2258]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 138.821232] setup-gitlab-start[2258]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 138.822277] setup-gitlab-start[2258]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 150.557301] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"512f902900fb9ca02c90aacc","created_at":"2026-08-16T17:05:04.314Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"575a09390e667567c577c542a221c6ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.331Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-512f902900fb9ca02c90aacc: start","job_status":"start","queue_duration_s":0.001555,"scheduling_latency_s":0.001585} gitlab # [ 150.706692] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"512f902900fb9ca02c90aacc","created_at":"2026-08-16T17:05:04.314Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"575a09390e667567c577c542a221c6ac","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.331Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-512f902900fb9ca02c90aacc: done: 0.150008 sec","job_status":"done","queue_duration_s":0.001555,"scheduling_latency_s":0.001585,"redis_calls":14,"redis_duration_s":0.011193999999999999,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002762,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00418,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001030578,"exclusive_lock_hold_duration_s":0.104411594,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.150008,"completed_at":"2026-08-16T17:05:04.483Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.745986] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"83d1353c984ae550b8a0d56f","created_at":"2026-08-16T17:05:04.338Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25c16584acd38cb222bb6bb029397e59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.351Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-83d1353c984ae550b8a0d56f: start","job_status":"start","queue_duration_s":0.171522,"scheduling_latency_s":0.17155} gitlab # [ 150.769573] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.546Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 150.778869] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"83d1353c984ae550b8a0d56f","created_at":"2026-08-16T17:05:04.338Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25c16584acd38cb222bb6bb029397e59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.351Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-83d1353c984ae550b8a0d56f: done: 0.032874 sec","job_status":"done","queue_duration_s":0.171522,"scheduling_latency_s":0.17155,"redis_calls":10,"redis_duration_s":0.002801,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000825,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001592,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000271264,"duration_s":0.032874,"completed_at":"2026-08-16T17:05:04.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.813664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f85f7ce45c6a352c900a9abe","created_at":"2026-08-16T17:05:04.362Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a55425ced474b0cc89df57be74ad7aab","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.370Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f85f7ce45c6a352c900a9abe: start","job_status":"start","queue_duration_s":0.22013,"scheduling_latency_s":0.220153} gitlab # [ 150.871078] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.647Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f85f7ce45c6a352c900a9abe","created_at":"2026-08-16T17:05:04.362Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a55425ced474b0cc89df57be74ad7aab","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.370Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f85f7ce45c6a352c900a9abe: done: 0.05743 sec","job_status":"done","queue_duration_s":0.22013,"scheduling_latency_s":0.220153,"redis_calls":16,"redis_duration_s":0.006491,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003015,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000596724,"duration_s":0.05743,"completed_at":"2026-08-16T17:05:04.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.905401] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"260afc92d27b6d4e053a63fc","created_at":"2026-08-16T17:05:04.389Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a7f0600fa1d343b6011c7cdd2f861fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:04.396Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-260afc92d27b6d4e053a63fc: start","job_status":"start","queue_duration_s":0.285207,"scheduling_latency_s":0.285232} gitlab # [ 150.941472] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.718Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 150.960242] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"260afc92d27b6d4e053a63fc","created_at":"2026-08-16T17:05:04.389Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a7f0600fa1d343b6011c7cdd2f861fc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:04.396Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-260afc92d27b6d4e053a63fc: done: 0.054836 sec","job_status":"done","queue_duration_s":0.285207,"scheduling_latency_s":0.285232,"redis_calls":10,"redis_duration_s":0.015233,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001167,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00978588,"duration_s":0.054836,"completed_at":"2026-08-16T17:05:04.736Z","load_balancing_strategy":"primary","db_duration_s":0.000499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 150.994848] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"00df9a196be7c4048d2a4a01","created_at":"2026-08-16T17:05:04.432Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5a523dd6b9a61f2fe13c101cfca4015","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.442Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-00df9a196be7c4048d2a4a01: start","job_status":"start","queue_duration_s":0.328789,"scheduling_latency_s":0.32881} gitlab # [ 151.059241] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"00df9a196be7c4048d2a4a01","created_at":"2026-08-16T17:05:04.432Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5a523dd6b9a61f2fe13c101cfca4015","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.442Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-00df9a196be7c4048d2a4a01: done: 0.063713 sec","job_status":"done","queue_duration_s":0.328789,"scheduling_latency_s":0.32881,"redis_calls":12,"redis_duration_s":0.02701,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002884,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.018287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000734451,"duration_s":0.063713,"completed_at":"2026-08-16T17:05:04.835Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.099192] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c9472735bf8042681c095d2a","created_at":"2026-08-16T17:05:04.451Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"179685812acddea7723b02802983e1b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.458Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c9472735bf8042681c095d2a: start","job_status":"start","queue_duration_s":0.416884,"scheduling_latency_s":0.416906} gitlab # [ 151.134768] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.911Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 151.168068] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c9472735bf8042681c095d2a","created_at":"2026-08-16T17:05:04.451Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"179685812acddea7723b02802983e1b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.458Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c9472735bf8042681c095d2a: done: 0.069034 sec","job_status":"done","queue_duration_s":0.416884,"scheduling_latency_s":0.416906,"redis_calls":10,"redis_duration_s":0.014215,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001861,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005084,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000880838,"duration_s":0.069034,"completed_at":"2026-08-16T17:05:04.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000622,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.173846] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"309cb67bf6f208ace90d5b1c","created_at":"2026-08-16T17:05:04.470Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cdc3051a7817ec60cfeaf46729b0fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.477Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-309cb67bf6f208ace90d5b1c: start","job_status":"start","queue_duration_s":0.472649,"scheduling_latency_s":0.472669} gitlab # [ 151.214334] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"309cb67bf6f208ace90d5b1c","created_at":"2026-08-16T17:05:04.470Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3cdc3051a7817ec60cfeaf46729b0fc","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.477Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-309cb67bf6f208ace90d5b1c: done: 0.032148 sec","job_status":"done","queue_duration_s":0.472649,"scheduling_latency_s":0.472669,"redis_calls":12,"redis_duration_s":0.002602,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001018,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000571022,"exclusive_lock_hold_duration_s":0.005081093,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.032148,"completed_at":"2026-08-16T17:05:04.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.220463] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:04.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bc8982b280a38554fcd130f5","created_at":"2026-08-16T17:05:04.520Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d446b724003f308ebf2769e201d5b4dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.553Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bc8982b280a38554fcd130f5: start","job_status":"start","queue_duration_s":0.43052,"scheduling_latency_s":0.430535} gitlab # [ 151.234740] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bc8982b280a38554fcd130f5","created_at":"2026-08-16T17:05:04.520Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d446b724003f308ebf2769e201d5b4dc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.553Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bc8982b280a38554fcd130f5: done: 0.024134 sec","job_status":"done","queue_duration_s":0.43052,"scheduling_latency_s":0.430535,"redis_calls":10,"redis_duration_s":0.00192,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000433295,"duration_s":0.024134,"completed_at":"2026-08-16T17:05:05.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.284957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4dd2b6e9ec8fc1170c3a784c","created_at":"2026-08-16T17:05:04.602Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f5b6f653ef35682596e704e3795a6f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.610Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4dd2b6e9ec8fc1170c3a784c: start","job_status":"start","queue_duration_s":0.3996,"scheduling_latency_s":0.399615} gitlab # [ 151.285583] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.020Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 151.285982] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4dd2b6e9ec8fc1170c3a784c","created_at":"2026-08-16T17:05:04.602Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f5b6f653ef35682596e704e3795a6f7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.610Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4dd2b6e9ec8fc1170c3a784c: done: 0.015484 sec","job_status":"done","queue_duration_s":0.3996,"scheduling_latency_s":0.399615,"redis_calls":10,"redis_duration_s":0.0012590000000000001,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209244,"duration_s":0.015484,"completed_at":"2026-08-16T17:05:05.025Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.332964] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c73cbdef2ba2b3bd7564cc6","created_at":"2026-08-16T17:05:04.619Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e557a4dafdcfd82745d26310c2bb20ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.624Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c73cbdef2ba2b3bd7564cc6: start","job_status":"start","queue_duration_s":0.402045,"scheduling_latency_s":0.402057} gitlab # [ 151.444166] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.220Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4c73cbdef2ba2b3bd7564cc6","created_at":"2026-08-16T17:05:04.619Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e557a4dafdcfd82745d26310c2bb20ba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.624Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4c73cbdef2ba2b3bd7564cc6: done: 0.193949 sec","job_status":"done","queue_duration_s":0.402045,"scheduling_latency_s":0.402057,"redis_calls":12,"redis_duration_s":0.004546,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001567,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.03,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000315403,"exclusive_lock_hold_duration_s":0.172884822,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.193949,"completed_at":"2026-08-16T17:05:05.220Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.067559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.485099] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b76a768966cc0f853d605bec","created_at":"2026-08-16T17:05:04.631Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"310fd5fb3ad26c0b9cce8a01def71f34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:04.635Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b76a768966cc0f853d605bec: start","job_status":"start","queue_duration_s":0.625613,"scheduling_latency_s":0.625667} gitlab # [ 151.529084] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.305Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 151.538501] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"b76a768966cc0f853d605bec","created_at":"2026-08-16T17:05:04.631Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"310fd5fb3ad26c0b9cce8a01def71f34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:04.635Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-b76a768966cc0f853d605bec: done: 0.053589 sec","job_status":"done","queue_duration_s":0.625613,"scheduling_latency_s":0.625667,"redis_calls":10,"redis_duration_s":0.008933,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000641,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231873,"duration_s":0.053589,"completed_at":"2026-08-16T17:05:05.314Z","load_balancing_strategy":"primary","db_duration_s":0.000483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.576133] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"8acd2d0d6f05ff051074582f","created_at":"2026-08-16T17:05:04.640Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d42ff2ee85bf38d7707f9b5dc865fb9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.648Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-8acd2d0d6f05ff051074582f: start","job_status":"start","queue_duration_s":0.703351,"scheduling_latency_s":0.703376} gitlab # [ 151.616259] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"8acd2d0d6f05ff051074582f","created_at":"2026-08-16T17:05:04.640Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d42ff2ee85bf38d7707f9b5dc865fb9","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.648Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-8acd2d0d6f05ff051074582f: done: 0.040388 sec","job_status":"done","queue_duration_s":0.703351,"scheduling_latency_s":0.703376,"redis_calls":11,"redis_duration_s":0.003113,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000855,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026847,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.040388,"completed_at":"2026-08-16T17:05:05.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.637316] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"57b8ee653a1488ef0d901700","created_at":"2026-08-16T17:05:04.704Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"804e2cc82c6f833c3930bd7eaa22c4bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.714Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-57b8ee653a1488ef0d901700: start","job_status":"start","queue_duration_s":0.680375,"scheduling_latency_s":0.680412} gitlab # [ 151.654414] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"57b8ee653a1488ef0d901700","created_at":"2026-08-16T17:05:04.704Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"804e2cc82c6f833c3930bd7eaa22c4bd","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.714Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-57b8ee653a1488ef0d901700: done: 0.036537 sec","job_status":"done","queue_duration_s":0.680375,"scheduling_latency_s":0.680412,"redis_calls":13,"redis_duration_s":0.003328,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000375,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.0021,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000853,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011210643,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.036537,"completed_at":"2026-08-16T17:05:05.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003215,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 151.666606] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.432Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"db966181afc1333fed8dc643","created_at":"2026-08-16T17:05:04.732Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ab3e4b579eea31a1a3a6ea999a6ebcb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.770Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-db966181afc1333fed8dc643: start","job_status":"start","queue_duration_s":0.661852,"scheduling_latency_s":0.661924} gitlab # [ 151.726414] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"db966181afc1333fed8dc643","created_at":"2026-08-16T17:05:04.732Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ab3e4b579eea31a1a3a6ea999a6ebcb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.770Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-db966181afc1333fed8dc643: done: 0.070264 sec","job_status":"done","queue_duration_s":0.661852,"scheduling_latency_s":0.661924,"redis_calls":10,"redis_duration_s":0.001473,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232711,"duration_s":0.070264,"completed_at":"2026-08-16T17:05:05.502Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.728440] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.505Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"58daca802d05ad7166eb36b5","created_at":"2026-08-16T17:05:04.791Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bff5043ceff16415a6cdbc03e320eef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.802Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-58daca802d05ad7166eb36b5: start","job_status":"start","queue_duration_s":0.702141,"scheduling_latency_s":0.702205} gitlab # [ 151.741925] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.518Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 151.753700] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.530Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"58daca802d05ad7166eb36b5","created_at":"2026-08-16T17:05:04.791Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bff5043ceff16415a6cdbc03e320eef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.802Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-58daca802d05ad7166eb36b5: done: 0.025281 sec","job_status":"done","queue_duration_s":0.702141,"scheduling_latency_s":0.702205,"redis_calls":10,"redis_duration_s":0.002182,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000396,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000511518,"duration_s":0.025281,"completed_at":"2026-08-16T17:05:05.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.795019] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"74b9a011c2499cfe4f5f7a58","created_at":"2026-08-16T17:05:04.826Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84821a70173cfd369173c652e818381a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.873Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-74b9a011c2499cfe4f5f7a58: start","job_status":"start","queue_duration_s":0.658099,"scheduling_latency_s":0.658113} gitlab # [ 151.896072] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"74b9a011c2499cfe4f5f7a58","created_at":"2026-08-16T17:05:04.826Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84821a70173cfd369173c652e818381a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.873Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-74b9a011c2499cfe4f5f7a58: done: 0.140546 sec","job_status":"done","queue_duration_s":0.658099,"scheduling_latency_s":0.658113,"redis_calls":10,"redis_duration_s":0.002012,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000383,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233829,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.140546,"completed_at":"2026-08-16T17:05:05.672Z","load_balancing_strategy":"primary","db_duration_s":0.014618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 151.898029] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3fdf10e91fdee8bfb25c101e","created_at":"2026-08-16T17:05:04.900Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.916Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3fdf10e91fdee8bfb25c101e: start","job_status":"start","queue_duration_s":0.758038,"scheduling_latency_s":0.758076} gitlab # [ 152.030387] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3fdf10e91fdee8bfb25c101e","created_at":"2026-08-16T17:05:04.900Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:04.916Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3fdf10e91fdee8bfb25c101e: done: 0.131899 sec","job_status":"done","queue_duration_s":0.758038,"scheduling_latency_s":0.758076,"redis_calls":71,"redis_duration_s":0.017447999999999998,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001974,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001312,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013387,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000295289,"duration_s":0.131899,"completed_at":"2026-08-16T17:05:05.806Z","load_balancing_strategy":"primary","db_duration_s":0.002453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.032962] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:05.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"196d09bc2771788893e0717b","created_at":"2026-08-16T17:05:04.946Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d12abe6fc09d68ce1dbe56b11d894b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.143Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-196d09bc2771788893e0717b: start","job_status":"start","queue_duration_s":0.665088,"scheduling_latency_s":0.665137} gitlab # [ 152.583897] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"196d09bc2771788893e0717b","created_at":"2026-08-16T17:05:04.946Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d12abe6fc09d68ce1dbe56b11d894b","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.143Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-196d09bc2771788893e0717b: done: 0.550905 sec","job_status":"done","queue_duration_s":0.665088,"scheduling_latency_s":0.665137,"redis_calls":565,"redis_duration_s":0.162889,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.16012,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.426407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060287,"duration_s":0.550905,"completed_at":"2026-08-16T17:05:06.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.651610] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e055c61439102df6b1773a29","created_at":"2026-08-16T17:05:05.152Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.159Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e055c61439102df6b1773a29: start","job_status":"start","queue_duration_s":1.20341,"scheduling_latency_s":1.203471} gitlab # [ 152.663801] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.434Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e055c61439102df6b1773a29","created_at":"2026-08-16T17:05:05.152Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.159Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e055c61439102df6b1773a29: done: 0.071348 sec","job_status":"done","queue_duration_s":1.20341,"scheduling_latency_s":1.203471,"redis_calls":19,"redis_duration_s":0.009213,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002094,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000741,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004726,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000789765,"duration_s":0.071348,"completed_at":"2026-08-16T17:05:06.434Z","load_balancing_strategy":"primary","db_duration_s":0.006451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.701886] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"180e7042bdfb60fa8c2b5c18","created_at":"2026-08-16T17:05:05.169Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f06a95560bcca7459caf57d3804d3106","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.176Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-180e7042bdfb60fa8c2b5c18: start","job_status":"start","queue_duration_s":1.260823,"scheduling_latency_s":1.260845} gitlab # [ 152.733286] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"180e7042bdfb60fa8c2b5c18","created_at":"2026-08-16T17:05:05.169Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f06a95560bcca7459caf57d3804d3106","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.176Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-180e7042bdfb60fa8c2b5c18: done: 0.072459 sec","job_status":"done","queue_duration_s":1.260823,"scheduling_latency_s":1.260845,"redis_calls":12,"redis_duration_s":0.005711,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000887,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001132546,"exclusive_lock_hold_duration_s":0.014195658,"duration_s":0.072459,"completed_at":"2026-08-16T17:05:06.509Z","load_balancing_strategy":"primary","db_duration_s":0.007053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.773132] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c82fa9fc6ba78a0315ebfe43","created_at":"2026-08-16T17:05:05.190Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c55981a86ff57e9f12981479ea6a506","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.198Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c82fa9fc6ba78a0315ebfe43: start","job_status":"start","queue_duration_s":1.313336,"scheduling_latency_s":1.313382} gitlab # [ 152.814932] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.591Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c82fa9fc6ba78a0315ebfe43","created_at":"2026-08-16T17:05:05.190Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c55981a86ff57e9f12981479ea6a506","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.198Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c82fa9fc6ba78a0315ebfe43: done: 0.07937 sec","job_status":"done","queue_duration_s":1.313336,"scheduling_latency_s":1.313382,"redis_calls":12,"redis_duration_s":0.004725,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002038,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000887823,"exclusive_lock_hold_duration_s":0.015294681,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.07937,"completed_at":"2026-08-16T17:05:06.591Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.817057] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0ced940b8bc724e018f44d0c","created_at":"2026-08-16T17:05:05.206Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21e1961302e2230c328fb36cbfe3c29b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.211Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0ced940b8bc724e018f44d0c: start","job_status":"start","queue_duration_s":1.381966,"scheduling_latency_s":1.381985} gitlab # [ 152.864531] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.640Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0ced940b8bc724e018f44d0c","created_at":"2026-08-16T17:05:05.206Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21e1961302e2230c328fb36cbfe3c29b","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.211Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0ced940b8bc724e018f44d0c: done: 0.046925 sec","job_status":"done","queue_duration_s":1.381966,"scheduling_latency_s":1.381985,"redis_calls":10,"redis_duration_s":0.003307,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000644,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000648965,"duration_s":0.046925,"completed_at":"2026-08-16T17:05:06.640Z","load_balancing_strategy":"primary","db_duration_s":0.007176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.866671] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"51ba5fcbea008c65d4073f6b","created_at":"2026-08-16T17:05:05.275Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72fd2397f98dfd34dd70117d348b497b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.283Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-51ba5fcbea008c65d4073f6b: start","job_status":"start","queue_duration_s":1.360064,"scheduling_latency_s":1.360103} gitlab # [ 152.923212] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"51ba5fcbea008c65d4073f6b","created_at":"2026-08-16T17:05:05.275Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-10f514b25cce4c8a","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72fd2397f98dfd34dd70117d348b497b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.283Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-51ba5fcbea008c65d4073f6b: done: 0.056499 sec","job_status":"done","queue_duration_s":1.360064,"scheduling_latency_s":1.360103,"redis_calls":10,"redis_duration_s":0.004031,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00083,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000604,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000446984,"duration_s":0.056499,"completed_at":"2026-08-16T17:05:06.699Z","load_balancing_strategy":"primary","db_duration_s":0.010113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.925557] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5d8fc05d2110db37162904","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5d8fc05d2110db37162904: start","job_status":"start","queue_duration_s":0.909474,"scheduling_latency_s":0.909497} gitlab # [ 152.965271] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5d8fc05d2110db37162904","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5d8fc05d2110db37162904: done: 0.040333 sec","job_status":"done","queue_duration_s":0.909474,"scheduling_latency_s":0.909497,"redis_calls":16,"redis_duration_s":0.0059640000000000006,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0035,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000645892,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040333,"completed_at":"2026-08-16T17:05:06.741Z","load_balancing_strategy":"primary","db_duration_s":0.001028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 152.974730] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a064face24f8e65eccf994b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a064face24f8e65eccf994b: start","job_status":"start","queue_duration_s":0.951645,"scheduling_latency_s":0.951662} gitlab # [ 153.018215] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a064face24f8e65eccf994b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a064face24f8e65eccf994b: done: 0.022458 sec","job_status":"done","queue_duration_s":0.951645,"scheduling_latency_s":0.951662,"redis_calls":13,"redis_duration_s":0.004334,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003151,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022458,"completed_at":"2026-08-16T17:05:06.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.062263] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dbffd3e31dc40ba046e04db","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dbffd3e31dc40ba046e04db: start","job_status":"start","queue_duration_s":0.975676,"scheduling_latency_s":0.975721} gitlab # [ 153.063421] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dbffd3e31dc40ba046e04db","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dbffd3e31dc40ba046e04db: done: 0.024175 sec","job_status":"done","queue_duration_s":0.975676,"scheduling_latency_s":0.975721,"redis_calls":13,"redis_duration_s":0.004521,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024175,"completed_at":"2026-08-16T17:05:06.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.105867] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39b68ddf2e24fc984405229","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39b68ddf2e24fc984405229: start","job_status":"start","queue_duration_s":1.002549,"scheduling_latency_s":1.002574} gitlab # [ 153.107318] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39b68ddf2e24fc984405229","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39b68ddf2e24fc984405229: done: 0.027548 sec","job_status":"done","queue_duration_s":1.002549,"scheduling_latency_s":1.002574,"redis_calls":13,"redis_duration_s":0.005141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001472,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027548,"completed_at":"2026-08-16T17:05:06.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.120298] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edadcdefbabe25eb11a1f309","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edadcdefbabe25eb11a1f309: start","job_status":"start","queue_duration_s":1.032192,"scheduling_latency_s":1.032232} gitlab # [ 153.171890] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edadcdefbabe25eb11a1f309","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edadcdefbabe25eb11a1f309: done: 0.023319 sec","job_status":"done","queue_duration_s":1.032192,"scheduling_latency_s":1.032232,"redis_calls":13,"redis_duration_s":0.004529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001455,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023319,"completed_at":"2026-08-16T17:05:06.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.173375] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72609a6b327558b29eb722f7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72609a6b327558b29eb722f7: start","job_status":"start","queue_duration_s":1.058111,"scheduling_latency_s":1.058174} gitlab # [ 153.212622] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72609a6b327558b29eb722f7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72609a6b327558b29eb722f7: done: 0.021454 sec","job_status":"done","queue_duration_s":1.058111,"scheduling_latency_s":1.058174,"redis_calls":13,"redis_duration_s":0.004056000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021454,"completed_at":"2026-08-16T17:05:06.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.213721] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10e770c30cfe2f03b629c431","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10e770c30cfe2f03b629c431: start","job_status":"start","queue_duration_s":1.082353,"scheduling_latency_s":1.082397} gitlab # [ 153.224251] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10e770c30cfe2f03b629c431","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10e770c30cfe2f03b629c431: done: 0.021284 sec","job_status":"done","queue_duration_s":1.082353,"scheduling_latency_s":1.082397,"redis_calls":13,"redis_duration_s":0.002591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021284,"completed_at":"2026-08-16T17:05:06.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.271816] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa869a9b019097f2abf2627b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa869a9b019097f2abf2627b: start","job_status":"start","queue_duration_s":1.105651,"scheduling_latency_s":1.105686} gitlab # [ 153.272768] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa869a9b019097f2abf2627b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa869a9b019097f2abf2627b: done: 0.024078 sec","job_status":"done","queue_duration_s":1.105651,"scheduling_latency_s":1.105686,"redis_calls":13,"redis_duration_s":0.003424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024078,"completed_at":"2026-08-16T17:05:06.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.310574] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2502855e7ecba1ff3917ff50","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2502855e7ecba1ff3917ff50: start","job_status":"start","queue_duration_s":1.132247,"scheduling_latency_s":1.132263} gitlab # [ 153.361616] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2502855e7ecba1ff3917ff50","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2502855e7ecba1ff3917ff50: done: 0.024588 sec","job_status":"done","queue_duration_s":1.132247,"scheduling_latency_s":1.132263,"redis_calls":13,"redis_duration_s":0.0036950000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001139,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002556,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024588,"completed_at":"2026-08-16T17:05:06.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.362668] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800c087e2bb6525f873366e8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800c087e2bb6525f873366e8: start","job_status":"start","queue_duration_s":1.159716,"scheduling_latency_s":1.15974} gitlab # [ 153.370243] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"800c087e2bb6525f873366e8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-800c087e2bb6525f873366e8: done: 0.023598 sec","job_status":"done","queue_duration_s":1.159716,"scheduling_latency_s":1.15974,"redis_calls":13,"redis_duration_s":0.003062,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023598,"completed_at":"2026-08-16T17:05:06.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.427401] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:06.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6897ed5e52499cb7d4c4687","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6897ed5e52499cb7d4c4687: start","job_status":"start","queue_duration_s":1.185197,"scheduling_latency_s":1.185214} gitlab # [ 153.428615] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6897ed5e52499cb7d4c4687","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6897ed5e52499cb7d4c4687: done: 0.072751 sec","job_status":"done","queue_duration_s":1.185197,"scheduling_latency_s":1.185214,"redis_calls":13,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001716,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.072751,"completed_at":"2026-08-16T17:05:07.049Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.477054] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eee69683875e3a0688966a7b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eee69683875e3a0688966a7b: start","job_status":"start","queue_duration_s":1.279324,"scheduling_latency_s":1.27939} gitlab # [ 153.477884] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eee69683875e3a0688966a7b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eee69683875e3a0688966a7b: done: 0.052643 sec","job_status":"done","queue_duration_s":1.279324,"scheduling_latency_s":1.27939,"redis_calls":13,"redis_duration_s":0.012743,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003735,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052643,"completed_at":"2026-08-16T17:05:07.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.520296] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe196e6f3924994ead5bc48b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe196e6f3924994ead5bc48b: start","job_status":"start","queue_duration_s":1.337713,"scheduling_latency_s":1.337763} gitlab # [ 153.521203] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fe196e6f3924994ead5bc48b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fe196e6f3924994ead5bc48b: done: 0.071962 sec","job_status":"done","queue_duration_s":1.337713,"scheduling_latency_s":1.337763,"redis_calls":13,"redis_duration_s":0.036000000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004423,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.031577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.071962,"completed_at":"2026-08-16T17:05:07.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.575265] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa841ce90cb47b0461322a3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa841ce90cb47b0461322a3: start","job_status":"start","queue_duration_s":1.425611,"scheduling_latency_s":1.425661} gitlab # [ 153.575959] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aaa841ce90cb47b0461322a3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aaa841ce90cb47b0461322a3: done: 0.049314 sec","job_status":"done","queue_duration_s":1.425611,"scheduling_latency_s":1.425661,"redis_calls":13,"redis_duration_s":0.016538999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012698,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.049314,"completed_at":"2026-08-16T17:05:07.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.630449] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c9192252d6491de9ae52f1c","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c9192252d6491de9ae52f1c: start","job_status":"start","queue_duration_s":1.481284,"scheduling_latency_s":1.481302} gitlab # [ 153.631267] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c9192252d6491de9ae52f1c","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c9192252d6491de9ae52f1c: done: 0.046437 sec","job_status":"done","queue_duration_s":1.481284,"scheduling_latency_s":1.481302,"redis_calls":13,"redis_duration_s":0.016772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006689,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046437,"completed_at":"2026-08-16T17:05:07.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.646231] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"776a346f521168cc3d484d20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-776a346f521168cc3d484d20: start","job_status":"start","queue_duration_s":1.533791,"scheduling_latency_s":1.533811} gitlab # [ 153.657945] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"776a346f521168cc3d484d20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-776a346f521168cc3d484d20: done: 0.061965 sec","job_status":"done","queue_duration_s":1.533791,"scheduling_latency_s":1.533811,"redis_calls":13,"redis_duration_s":0.008382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005217,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.061965,"completed_at":"2026-08-16T17:05:07.387Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.717765] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0b91c15cc7c1ce9517d1b8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0b91c15cc7c1ce9517d1b8: start","job_status":"start","queue_duration_s":1.6023,"scheduling_latency_s":1.602341} gitlab # [ 153.720278] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee0b91c15cc7c1ce9517d1b8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee0b91c15cc7c1ce9517d1b8: done: 0.046865 sec","job_status":"done","queue_duration_s":1.6023,"scheduling_latency_s":1.602341,"redis_calls":13,"redis_duration_s":0.008029000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046865,"completed_at":"2026-08-16T17:05:07.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.763114] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6340d34ef69e389a163a0e77","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6340d34ef69e389a163a0e77: start","job_status":"start","queue_duration_s":1.653069,"scheduling_latency_s":1.65309} gitlab # [ 153.765052] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6340d34ef69e389a163a0e77","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6340d34ef69e389a163a0e77: done: 0.060939 sec","job_status":"done","queue_duration_s":1.653069,"scheduling_latency_s":1.65309,"redis_calls":13,"redis_duration_s":0.020639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060939,"completed_at":"2026-08-16T17:05:07.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.811744] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26833beaf70d159ee49556d0","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26833beaf70d159ee49556d0: start","job_status":"start","queue_duration_s":1.724585,"scheduling_latency_s":1.724634} gitlab # [ 153.812988] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26833beaf70d159ee49556d0","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26833beaf70d159ee49556d0: done: 0.064122 sec","job_status":"done","queue_duration_s":1.724585,"scheduling_latency_s":1.724634,"redis_calls":13,"redis_duration_s":0.021628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007377,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014251,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064122,"completed_at":"2026-08-16T17:05:07.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.874475] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dec21cb22a8b8a8b037870a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dec21cb22a8b8a8b037870a: start","job_status":"start","queue_duration_s":1.815293,"scheduling_latency_s":1.815324} gitlab # [ 153.882121] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dec21cb22a8b8a8b037870a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dec21cb22a8b8a8b037870a: done: 0.051343 sec","job_status":"done","queue_duration_s":1.815293,"scheduling_latency_s":1.815324,"redis_calls":13,"redis_duration_s":0.018288,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.051343,"completed_at":"2026-08-16T17:05:07.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 153.903895] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f60ff4a97a2d8daead33225b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f60ff4a97a2d8daead33225b: start","job_status":"start","queue_duration_s":1.868329,"scheduling_latency_s":1.868348} gitlab # [ 154.007974] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f60ff4a97a2d8daead33225b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f60ff4a97a2d8daead33225b: done: 0.123577 sec","job_status":"done","queue_duration_s":1.868329,"scheduling_latency_s":1.868348,"redis_calls":13,"redis_duration_s":0.017532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.123577,"completed_at":"2026-08-16T17:05:07.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.033988] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8c350be3e016bd79cd6a254","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8c350be3e016bd79cd6a254: start","job_status":"start","queue_duration_s":1.998571,"scheduling_latency_s":1.998613} gitlab # [ 154.042707] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8c350be3e016bd79cd6a254","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8c350be3e016bd79cd6a254: done: 0.028932 sec","job_status":"done","queue_duration_s":1.998571,"scheduling_latency_s":1.998613,"redis_calls":13,"redis_duration_s":0.005742000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002399,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003343,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028932,"completed_at":"2026-08-16T17:05:07.819Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.053420] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c255f8be43fb54c4046013f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c255f8be43fb54c4046013f: start","job_status":"start","queue_duration_s":2.028687,"scheduling_latency_s":2.02871} gitlab # [ 154.065843] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c255f8be43fb54c4046013f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c255f8be43fb54c4046013f: done: 0.021959 sec","job_status":"done","queue_duration_s":2.028687,"scheduling_latency_s":2.02871,"redis_calls":13,"redis_duration_s":0.003758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003156,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021959,"completed_at":"2026-08-16T17:05:07.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.106816] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccf2c3cfb00ba7b48f101a1b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccf2c3cfb00ba7b48f101a1b: start","job_status":"start","queue_duration_s":2.052757,"scheduling_latency_s":2.052775} gitlab # [ 154.134315] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccf2c3cfb00ba7b48f101a1b","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccf2c3cfb00ba7b48f101a1b: done: 0.066137 sec","job_status":"done","queue_duration_s":2.052757,"scheduling_latency_s":2.052775,"redis_calls":13,"redis_duration_s":0.010093,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007507,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.066137,"completed_at":"2026-08-16T17:05:07.910Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.140081] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0e8c15d1b32dc662e12d867","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0e8c15d1b32dc662e12d867: start","job_status":"start","queue_duration_s":2.124843,"scheduling_latency_s":2.124866} gitlab # [ 154.175650] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0e8c15d1b32dc662e12d867","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0e8c15d1b32dc662e12d867: done: 0.035629 sec","job_status":"done","queue_duration_s":2.124843,"scheduling_latency_s":2.124866,"redis_calls":13,"redis_duration_s":0.012264,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007326,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035629,"completed_at":"2026-08-16T17:05:07.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.179630] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233731c76281eb89f934d9d7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233731c76281eb89f934d9d7: start","job_status":"start","queue_duration_s":2.161497,"scheduling_latency_s":2.161515} gitlab # [ 154.214203] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233731c76281eb89f934d9d7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233731c76281eb89f934d9d7: done: 0.017086 sec","job_status":"done","queue_duration_s":2.161497,"scheduling_latency_s":2.161515,"redis_calls":13,"redis_duration_s":0.0025109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017086,"completed_at":"2026-08-16T17:05:07.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.219720] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471a79d462e430253678248d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471a79d462e430253678248d: start","job_status":"start","queue_duration_s":2.180457,"scheduling_latency_s":2.180473} gitlab # [ 154.254979] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"471a79d462e430253678248d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-471a79d462e430253678248d: done: 0.017225 sec","job_status":"done","queue_duration_s":2.180457,"scheduling_latency_s":2.180473,"redis_calls":13,"redis_duration_s":0.002422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017225,"completed_at":"2026-08-16T17:05:07.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.260224] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:07.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"854c24081f3d7a39e4e5524f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-854c24081f3d7a39e4e5524f: start","job_status":"start","queue_duration_s":2.199318,"scheduling_latency_s":2.199332} gitlab # [ 154.300991] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"854c24081f3d7a39e4e5524f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-854c24081f3d7a39e4e5524f: done: 0.01341 sec","job_status":"done","queue_duration_s":2.199318,"scheduling_latency_s":2.199332,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01341,"completed_at":"2026-08-16T17:05:08.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.303404] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec22921b7cc8bb67ed74ff6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec22921b7cc8bb67ed74ff6: start","job_status":"start","queue_duration_s":2.214494,"scheduling_latency_s":2.214513} gitlab # [ 154.338095] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec22921b7cc8bb67ed74ff6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec22921b7cc8bb67ed74ff6: done: 0.017001 sec","job_status":"done","queue_duration_s":2.214494,"scheduling_latency_s":2.214513,"redis_calls":13,"redis_duration_s":0.002241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017001,"completed_at":"2026-08-16T17:05:08.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.339543] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef3f0778d3705842da0cae2","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef3f0778d3705842da0cae2: start","job_status":"start","queue_duration_s":2.232558,"scheduling_latency_s":2.232571} gitlab # [ 154.381126] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.060Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ef3f0778d3705842da0cae2","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ef3f0778d3705842da0cae2: done: 0.036082 sec","job_status":"done","queue_duration_s":2.232558,"scheduling_latency_s":2.232571,"redis_calls":13,"redis_duration_s":0.001759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036082,"completed_at":"2026-08-16T17:05:08.060Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.382098] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d186d6fcee007fc6aefc16d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d186d6fcee007fc6aefc16d: start","job_status":"start","queue_duration_s":2.273701,"scheduling_latency_s":2.273721} gitlab # [ 154.420973] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d186d6fcee007fc6aefc16d","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d186d6fcee007fc6aefc16d: done: 0.021844 sec","job_status":"done","queue_duration_s":2.273701,"scheduling_latency_s":2.273721,"redis_calls":13,"redis_duration_s":0.005922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004049,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021844,"completed_at":"2026-08-16T17:05:08.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.421792] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3047d0a4b3386051225eb3f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3047d0a4b3386051225eb3f: start","job_status":"start","queue_duration_s":2.297459,"scheduling_latency_s":2.297474} gitlab # [ 154.429545] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3047d0a4b3386051225eb3f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3047d0a4b3386051225eb3f: done: 0.018086 sec","job_status":"done","queue_duration_s":2.297459,"scheduling_latency_s":2.297474,"redis_calls":13,"redis_duration_s":0.002273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018086,"completed_at":"2026-08-16T17:05:08.107Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.471957] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f601f8b0409f838e476de2a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f601f8b0409f838e476de2a: start","job_status":"start","queue_duration_s":2.317415,"scheduling_latency_s":2.317431} gitlab # [ 154.472654] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f601f8b0409f838e476de2a","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f601f8b0409f838e476de2a: done: 0.017203 sec","job_status":"done","queue_duration_s":2.317415,"scheduling_latency_s":2.317431,"redis_calls":13,"redis_duration_s":0.0015409999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017203,"completed_at":"2026-08-16T17:05:08.126Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.527755] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"502769b6dcf250e35501274f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-502769b6dcf250e35501274f: start","job_status":"start","queue_duration_s":2.336738,"scheduling_latency_s":2.336762} gitlab # [ 154.528612] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"502769b6dcf250e35501274f","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-502769b6dcf250e35501274f: done: 0.020342 sec","job_status":"done","queue_duration_s":2.336738,"scheduling_latency_s":2.336762,"redis_calls":13,"redis_duration_s":0.002502,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001757,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020342,"completed_at":"2026-08-16T17:05:08.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.572911] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"359c6d8d46321ee18f65c848","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-359c6d8d46321ee18f65c848: start","job_status":"start","queue_duration_s":2.358908,"scheduling_latency_s":2.358926} gitlab # [ 154.573583] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"359c6d8d46321ee18f65c848","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-359c6d8d46321ee18f65c848: done: 0.020366 sec","job_status":"done","queue_duration_s":2.358908,"scheduling_latency_s":2.358926,"redis_calls":13,"redis_duration_s":0.002623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001259,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001364,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020366,"completed_at":"2026-08-16T17:05:08.171Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.583573] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c750459525c68085be2d5fd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c750459525c68085be2d5fd: start","job_status":"start","queue_duration_s":2.381104,"scheduling_latency_s":2.381143} gitlab # [ 154.617867] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c750459525c68085be2d5fd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c750459525c68085be2d5fd: done: 0.019996 sec","job_status":"done","queue_duration_s":2.381104,"scheduling_latency_s":2.381143,"redis_calls":13,"redis_duration_s":0.005069,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003532,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019996,"completed_at":"2026-08-16T17:05:08.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.623296] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9040524bd1b0dce7256c4d28","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9040524bd1b0dce7256c4d28: start","job_status":"start","queue_duration_s":2.402371,"scheduling_latency_s":2.402386} gitlab # [ 154.634587] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9040524bd1b0dce7256c4d28","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9040524bd1b0dce7256c4d28: done: 0.028328 sec","job_status":"done","queue_duration_s":2.402371,"scheduling_latency_s":2.402386,"redis_calls":13,"redis_duration_s":0.004431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028328,"completed_at":"2026-08-16T17:05:08.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.670118] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de08bf8acb5b22e3c28eeccc","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de08bf8acb5b22e3c28eeccc: start","job_status":"start","queue_duration_s":2.443965,"scheduling_latency_s":2.443984} gitlab # [ 154.673773] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de08bf8acb5b22e3c28eeccc","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de08bf8acb5b22e3c28eeccc: done: 0.021156 sec","job_status":"done","queue_duration_s":2.443965,"scheduling_latency_s":2.443984,"redis_calls":13,"redis_duration_s":0.007320999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001663,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005658,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021156,"completed_at":"2026-08-16T17:05:08.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.714629] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1124e60ce20ff7bbac1d5fb","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1124e60ce20ff7bbac1d5fb: start","job_status":"start","queue_duration_s":2.466149,"scheduling_latency_s":2.466167} gitlab # [ 154.715424] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1124e60ce20ff7bbac1d5fb","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1124e60ce20ff7bbac1d5fb: done: 0.018583 sec","job_status":"done","queue_duration_s":2.466149,"scheduling_latency_s":2.466167,"redis_calls":13,"redis_duration_s":0.00164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018583,"completed_at":"2026-08-16T17:05:08.276Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.753658] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e203dce5eb0eabd38340575","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e203dce5eb0eabd38340575: start","job_status":"start","queue_duration_s":2.486709,"scheduling_latency_s":2.486731} gitlab # [ 154.754257] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e203dce5eb0eabd38340575","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e203dce5eb0eabd38340575: done: 0.021809 sec","job_status":"done","queue_duration_s":2.486709,"scheduling_latency_s":2.486731,"redis_calls":13,"redis_duration_s":0.003329,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021809,"completed_at":"2026-08-16T17:05:08.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.789089] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df266c5ddb992c361383646","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df266c5ddb992c361383646: start","job_status":"start","queue_duration_s":2.51015,"scheduling_latency_s":2.510171} gitlab # [ 154.794774] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0df266c5ddb992c361383646","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0df266c5ddb992c361383646: done: 0.021842 sec","job_status":"done","queue_duration_s":2.51015,"scheduling_latency_s":2.510171,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021842,"completed_at":"2026-08-16T17:05:08.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.858625] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5445dd4c24d778a498808fd7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5445dd4c24d778a498808fd7: start","job_status":"start","queue_duration_s":2.535034,"scheduling_latency_s":2.535053} gitlab # [ 154.859292] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5445dd4c24d778a498808fd7","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5445dd4c24d778a498808fd7: done: 0.018269 sec","job_status":"done","queue_duration_s":2.535034,"scheduling_latency_s":2.535053,"redis_calls":13,"redis_duration_s":0.002693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018269,"completed_at":"2026-08-16T17:05:08.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.866531] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5da8822e32c7d0adc5eea8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5da8822e32c7d0adc5eea8: start","job_status":"start","queue_duration_s":2.555236,"scheduling_latency_s":2.555253} gitlab # [ 154.902899] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a5da8822e32c7d0adc5eea8","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a5da8822e32c7d0adc5eea8: done: 0.14169 sec","job_status":"done","queue_duration_s":2.555236,"scheduling_latency_s":2.555253,"redis_calls":13,"redis_duration_s":0.097153,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002705,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.094448,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.14169,"completed_at":"2026-08-16T17:05:08.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.940039] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c06aaee0d89cda143bc2744","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c06aaee0d89cda143bc2744: start","job_status":"start","queue_duration_s":2.713418,"scheduling_latency_s":2.713442} gitlab # [ 154.940772] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c06aaee0d89cda143bc2744","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c06aaee0d89cda143bc2744: done: 0.024072 sec","job_status":"done","queue_duration_s":2.713418,"scheduling_latency_s":2.713442,"redis_calls":13,"redis_duration_s":0.007176999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024072,"completed_at":"2026-08-16T17:05:08.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.952585] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b70d4b4507a5fdfad4768bd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b70d4b4507a5fdfad4768bd: start","job_status":"start","queue_duration_s":2.741259,"scheduling_latency_s":2.741277} gitlab # [ 154.993586] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b70d4b4507a5fdfad4768bd","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b70d4b4507a5fdfad4768bd: done: 0.026875 sec","job_status":"done","queue_duration_s":2.741259,"scheduling_latency_s":2.741277,"redis_calls":13,"redis_duration_s":0.009600000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026875,"completed_at":"2026-08-16T17:05:08.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 154.994619] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d39683a9fcc08d3d5c7fd3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d39683a9fcc08d3d5c7fd3: start","job_status":"start","queue_duration_s":2.772395,"scheduling_latency_s":2.772415} gitlab # [ 155.113974] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d1d39683a9fcc08d3d5c7fd3","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d1d39683a9fcc08d3d5c7fd3: done: 0.326104 sec","job_status":"done","queue_duration_s":2.772395,"scheduling_latency_s":2.772415,"redis_calls":13,"redis_duration_s":0.190002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.186115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.326104,"completed_at":"2026-08-16T17:05:08.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.118075] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98576788d5e1d348533726f6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98576788d5e1d348533726f6: start","job_status":"start","queue_duration_s":3.102061,"scheduling_latency_s":3.102083} gitlab # [ 155.141685] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98576788d5e1d348533726f6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98576788d5e1d348533726f6: done: 0.024249 sec","job_status":"done","queue_duration_s":3.102061,"scheduling_latency_s":3.102083,"redis_calls":13,"redis_duration_s":0.005673,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004426,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024249,"completed_at":"2026-08-16T17:05:08.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.179549] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0de5fbfcc9dec77bac9cb1ea","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0de5fbfcc9dec77bac9cb1ea: start","job_status":"start","queue_duration_s":3.133014,"scheduling_latency_s":3.133031} gitlab # [ 155.180166] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0de5fbfcc9dec77bac9cb1ea","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0de5fbfcc9dec77bac9cb1ea: done: 0.024436 sec","job_status":"done","queue_duration_s":3.133014,"scheduling_latency_s":3.133031,"redis_calls":13,"redis_duration_s":0.010583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024436,"completed_at":"2026-08-16T17:05:08.949Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.221045] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d317a028f3bc57fa0116dd20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d317a028f3bc57fa0116dd20: start","job_status":"start","queue_duration_s":3.159497,"scheduling_latency_s":3.159512} gitlab # [ 155.221524] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d317a028f3bc57fa0116dd20","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d317a028f3bc57fa0116dd20: done: 0.027425 sec","job_status":"done","queue_duration_s":3.159497,"scheduling_latency_s":3.159512,"redis_calls":13,"redis_duration_s":0.015081,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005707,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009374,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027425,"completed_at":"2026-08-16T17:05:08.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.232608] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:08.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9249f37edb623a8fea2561b6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9249f37edb623a8fea2561b6: start","job_status":"start","queue_duration_s":3.1902,"scheduling_latency_s":3.190217} gitlab # [ 155.269368] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9249f37edb623a8fea2561b6","created_at":"2026-08-16T17:05:05.701Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-91df69a1f1fc4918","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"ac31c5c42bcbf950f814b90c0c32e3fa","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.791Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9249f37edb623a8fea2561b6: done: 0.041503 sec","job_status":"done","queue_duration_s":3.1902,"scheduling_latency_s":3.190217,"redis_calls":13,"redis_duration_s":0.025348,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.021699,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041503,"completed_at":"2026-08-16T17:05:09.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.274988] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.026Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b0c58ed06af368500e79f0e9","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b0c58ed06af368500e79f0e9: start","job_status":"start","queue_duration_s":2.608567,"scheduling_latency_s":2.608588} gitlab # [ 155.310064] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.057Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.310669] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.075Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b0c58ed06af368500e79f0e9","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b0c58ed06af368500e79f0e9: done: 0.049293 sec","job_status":"done","queue_duration_s":2.608567,"scheduling_latency_s":2.608588,"redis_calls":13,"redis_duration_s":0.010658,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001071,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005104,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004483,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001618921,"duration_s":0.049293,"completed_at":"2026-08-16T17:05:09.075Z","load_balancing_strategy":"primary","db_duration_s":0.009598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.316155] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.078Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f53428abb429041f48a490ea","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f53428abb429041f48a490ea: start","job_status":"start","queue_duration_s":2.660076,"scheduling_latency_s":2.660096} gitlab # [ 155.352542] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.110Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.353083] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.125Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f53428abb429041f48a490ea","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f53428abb429041f48a490ea: done: 0.047115 sec","job_status":"done","queue_duration_s":2.660076,"scheduling_latency_s":2.660096,"redis_calls":10,"redis_duration_s":0.019725,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.01687,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047115,"completed_at":"2026-08-16T17:05:09.125Z","load_balancing_strategy":"primary","db_duration_s":0.008266,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.390312] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.127Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4175479dbb56610d5cf17ea0","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4175479dbb56610d5cf17ea0: start","job_status":"start","queue_duration_s":2.71,"scheduling_latency_s":2.710018} gitlab # [ 155.391055] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.153Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.392935] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.169Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4175479dbb56610d5cf17ea0","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4175479dbb56610d5cf17ea0: done: 0.041787 sec","job_status":"done","queue_duration_s":2.71,"scheduling_latency_s":2.710018,"redis_calls":10,"redis_duration_s":0.007928000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005322,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041787,"completed_at":"2026-08-16T17:05:09.169Z","load_balancing_strategy":"primary","db_duration_s":0.007502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 155.402813] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.178Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0ca181a2be7add9c73c0954","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0ca181a2be7add9c73c0954: start","job_status":"start","queue_duration_s":2.760493,"scheduling_latency_s":2.760514} gitlab # [ 155.441812] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.198Z","message":"No existing merge request to be cleaned up."} gitlab # [ 155.442664] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:09.209Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0ca181a2be7add9c73c0954","created_at":"2026-08-16T17:05:06.395Z","trace_propagation_headers":{"sentry-trace":"8ab9d788c01249adad266fd0f530a0cb-f2797418aa21453b","baggage":"sentry-trace_id=8ab9d788c01249adad266fd0f530a0cb,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"fa50aa4650291081dd452a543ad83a73","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.417Z","job_size_bytes":2,"pid":1640,"sidekiq_tid":"maf0","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0ca181a2be7add9c73c0954: done: 0.031219 sec","job_status":"done","queue_duration_s":2.760493,"scheduling_latency_s":2.760514,"redis_calls":10,"redis_duration_s":0.007346999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002486,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004861,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031219,"completed_at":"2026-08-16T17:05:09.209Z","load_balancing_strategy":"primary","db_duration_s":0.005102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 167.859487] setup-gitlab-start[2258]: W, [2026-08-16T17:05:21.635407 #2258] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 190.916397] postgres[2479]: [2479] ERROR: relation "table_without_models" does not exist gitlab # [ 190.916902] postgres[2479]: [2479] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 193.966880] runuser[2257]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 193.970281] setup-gitlab-start[2235]: + systemctl restart gitlab-sidekiq.service gitlab # [ 193.993131] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 193.994204] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.769Z","message":"Shutting down"} gitlab # [ 193.997529] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.774Z","message":"Scheduler exiting..."} gitlab # [ 194.000738] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.774Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 194.004409] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:47.775Z","message":"Scheduler exiting..."} gitlab # [ 194.499819] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:48.276Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 196.002182] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:49.778Z","message":"Bye!"} gitlab # [ 196.021785] sidekiq-cluster[1640]: {"severity":"INFO","time":"2026-08-16T17:05:49.798Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1640,"worker_id":"sidekiq_0","memwd_rss_bytes":947810304,"retry":0} gitlab # [ 198.298129] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 198.299700] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 198.301626] systemd[1]: gitlab-sidekiq.service: Consumed 1min 2.805s CPU time over 2min 3.197s wall clock time, 955.1M memory peak, 4.4M read from disk. gitlab # [ 198.303685] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 198.306961] setup-gitlab-start[2235]: + mkdir -p /var/lib/secrets gitlab # [ 198.311344] setup-gitlab-start[2235]: + echo nixbot-test-token-of-20-chars gitlab # [ 198.314480] setup-gitlab-start[2235]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 198.318352] setup-gitlab-start[2235]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 199.099223] gitaly[902]: time="2026-08-16T17:05:52.875Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:02.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:52.875" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.120555] gitaly[902]: time="2026-08-16T17:05:52.875Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:02.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:52.875" grpc.time_ms=0.29 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.248438] gitaly[902]: time="2026-08-16T17:05:53.025Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.024" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.269760] gitaly[902]: time="2026-08-16T17:05:53.025Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.024" grpc.time_ms=0.443 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.313636] gitaly[902]: time="2026-08-16T17:05:53.090Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ diskcache=31f59adb-990d-40ce-9477-1a5c57f6347c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.029" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.050" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.334523] gitaly[902]: time="2026-08-16T17:05:53.111Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.029" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.050" grpc.time_ms=40.181 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.371212] gitaly[902]: time="2026-08-16T17:05:53.147Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.126" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.147" pid=902 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 199.372583] gitaly[902]: time="2026-08-16T17:05:53.148Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.126" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.147" grpc.time_ms=0.781 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.412539] gitaly[902]: time="2026-08-16T17:05:53.189Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:03.157" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.178" grpc.time_ms=11.118 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.511848] gitaly[902]: time="2026-08-16T17:05:53.288Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.288" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.532842] gitaly[902]: time="2026-08-16T17:05:53.288Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.288" grpc.time_ms=0.451 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.572031] gitaly[902]: time="2026-08-16T17:05:53.348Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ diskcache=d0c9dafc-9ba2-4942-bbe9-d143b38bbddf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.272" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.293" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.572779] gitaly[902]: time="2026-08-16T17:05:53.349Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=33 command.spawn_token_fork_ms=5 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:03.272" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.293" grpc.time_ms=55.905 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.612778] gitaly[902]: time="2026-08-16T17:05:53.389Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.038" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.388" pid=902 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 199.613853] gitaly[902]: time="2026-08-16T17:05:53.389Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.038" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.388" grpc.time_ms=0.808 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.630355] gitaly[902]: time="2026-08-16T17:05:53.407Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:03.045" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.396" grpc.time_ms=10.586 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.667485] gitaly[902]: time="2026-08-16T17:05:53.444Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:03.093" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.443" grpc.time_ms=0.282 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 199.686492] gitaly[902]: time="2026-08-16T17:05:53.463Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:03.112" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:53.462" grpc.time_ms=0.292 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.263151] gitaly[902]: time="2026-08-16T17:05:54.039Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJWFPC8SWXJJSV1J5HHTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:04.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:54.028" grpc.time_ms=10.508 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 200.516217] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:54 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2173 gitlab # [ 200.520816] setup-gitlab-start[2235]: + mkdir -p /tmp/test-flake gitlab # [ 200.522968] setup-gitlab-start[2235]: + cd /tmp/test-flake gitlab # [ 200.524866] setup-gitlab-start[2235]: + git init -b master gitlab # [ 200.542579] setup-gitlab-start[2574]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 200.545368] setup-gitlab-start[2235]: + git config user.name test gitlab # [ 200.547514] setup-gitlab-start[2235]: + git config user.email test@example.com gitlab # [ 200.551122] setup-gitlab-start[2235]: + cat gitlab # [ 200.554618] setup-gitlab-start[2235]: + git add flake.nix gitlab # [ 200.561091] setup-gitlab-start[2235]: + git commit -m 'initial commit' gitlab # [ 200.579506] setup-gitlab-start[2579]: [master (root-commit) 0a07b83] initial commit gitlab # [ 200.580489] setup-gitlab-start[2579]: 1 file changed, 10 insertions(+) gitlab # [ 200.581534] setup-gitlab-start[2579]: create mode 100644 flake.nix gitlab # [ 200.585717] setup-gitlab-start[2235]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 200.593418] setup-gitlab-start[2235]: + git push -u origin master gitlab # [ 200.644418] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 27 gitlab # [ 201.265392] gitaly[902]: time="2026-08-16T17:05:55.041Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJYQTDG0026E5922F3QMQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:55.029" grpc.time_ms=11.719 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.267269] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:55 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 617 gitlab # [ 201.500607] sidekiq-cluster[2525]: {"severity":"INFO","time":"2026-08-16T17:05:55.259Z","message":"Starting cluster with 1 processes"} gitlab # [ 201.577127] gitaly[902]: time="2026-08-16T17:05:55.353Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:55.348" grpc.time_ms=5.316 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.604890] gitaly[902]: time="2026-08-16T17:05:55.381Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:06:25.074" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:05:55.374" grpc.time_ms=6.574 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.625790] gitaly[902]: time="2026-08-16T17:05:55.402Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RJZCD21JKPFK9SA7DGA9C duration_ms=151ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 201.656265] gitaly[902]: time="2026-08-16T17:05:55.433Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RJZCD21JKPFK9SA7DGA9C duration_ms=29ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 201.659164] gitaly[902]: time="2026-08-16T17:05:55.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.250" grpc.time_ms=185.53 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.699731] gitaly[902]: time="2026-08-16T17:05:55.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.475" grpc.time_ms=1.426 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.738800] gitaly[902]: time="2026-08-16T17:05:55.515Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.514" grpc.time_ms=1.051 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.777682] gitaly[902]: time="2026-08-16T17:05:55.554Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.554" grpc.time_ms=0.317 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.900195] gitaly[902]: time="2026-08-16T17:05:55.677Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:05.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:55.668" grpc.time_ms=8.291 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.943713] gitaly[902]: time="2026-08-16T17:05:55.720Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:06:05.038" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:55.698" grpc.time_ms=21.537 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 201.959030] gitaly[902]: time="2026-08-16T17:05:55.735Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RJZCD21JKPFK9SA7DGA9C duration_ms=151ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 201.962801] gitaly[902]: time="2026-08-16T17:05:55.739Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:55.584" grpc.time_ms=155.444 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.985193] gitaly[902]: time="2026-08-16T17:05:55.762Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C diskcache=8800466a-4a60-4407-b73f-346b833860d9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:55.166" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 201.996231] gitaly[902]: time="2026-08-16T17:05:55.773Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=195 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13688 command.oublock=32 command.real_time_ms=585 command.spawn_token_fork_ms=0 command.system_time_ms=126 command.user_time_ms=69 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:55.166" grpc.time_ms=595.941 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 202.011226] gitlab-workhorse[824]: time="2026-08-16T17:05:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 202.011982] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:55 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 702 gitlab # [ 202.017094] setup-gitlab-start[2583]: To http://gitlab/root/test-flake.git gitlab # [ 202.018087] setup-gitlab-start[2583]: * [new branch] master -> master gitlab # [ 202.023945] setup-gitlab-start[2583]: branch 'master' set up to track 'origin/master'. gitlab # [ 202.028524] systemd[1]: Finished setup-gitlab.service. gitlab # [ 202.033965] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 202.81 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 203.030250] nixbot[2674]: {"ts": "2026-08-16T17:05:56.806Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 203.051794] nixbot[2674]: {"ts": "2026-08-16T17:05:56.828Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 203.068740] nixbot[2674]: {"ts": "2026-08-16T17:05:56.845Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 203.077133] nixbot[2674]: {"ts": "2026-08-16T17:05:56.853Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 203.084569] nixbot[2674]: {"ts": "2026-08-16T17:05:56.861Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 203.093814] nixbot[2674]: {"ts": "2026-08-16T17:05:56.870Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 203.098803] nixbot[2674]: {"ts": "2026-08-16T17:05:56.874Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 203.104223] nixbot[2674]: {"ts": "2026-08-16T17:05:56.876Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 203.108900] nixbot[2674]: {"ts": "2026-08-16T17:05:56.884Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 203.113324] nixbot[2674]: {"ts": "2026-08-16T17:05:56.890Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 203.123571] nixbot[2674]: {"ts": "2026-08-16T17:05:56.900Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 203.135841] nixbot[2674]: {"ts": "2026-08-16T17:05:56.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 203.141302] nixbot[2674]: {"ts": "2026-08-16T17:05:56.916Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 203.147679] nixbot[2674]: {"ts": "2026-08-16T17:05:56.924Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 203.157599] nixbot[2674]: {"ts": "2026-08-16T17:05:56.934Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 203.165449] nixbot[2674]: {"ts": "2026-08-16T17:05:56.942Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 203.172580] nixbot[2674]: {"ts": "2026-08-16T17:05:56.949Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 203.179439] nixbot[2674]: {"ts": "2026-08-16T17:05:56.956Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 203.190381] nixbot[2674]: {"ts": "2026-08-16T17:05:56.966Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 203.197968] nixbot[2674]: {"ts": "2026-08-16T17:05:56.974Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 203.205335] nixbot[2674]: {"ts": "2026-08-16T17:05:56.982Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 203.216589] nixbot[2674]: {"ts": "2026-08-16T17:05:56.993Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 203.223694] nixbot[2674]: {"ts": "2026-08-16T17:05:57.000Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 203.232120] nixbot[2674]: {"ts": "2026-08-16T17:05:57.008Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 203.238864] nixbot[2674]: {"ts": "2026-08-16T17:05:57.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 203.529547] nixbot[2674]: INFO: Started server process [2674] gitlab # [ 203.530320] nixbot[2674]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 203.545715] nixbot[2674]: INFO: ::ffff:127.0.0.1:42846 - "GET /health HTTP/1.1" 200 OK gitlab # [ 203.552171] systemd[1]: Started nixbot CI service. gitlab # [ 203.556785] systemd[1]: Reached target Multi-User System. gitlab # [ 203.559285] systemd[1]: Startup finished in 1.072s (kernel) + 3.374s (initrd) + 3min 19.111s (userspace) = 3min 23.559s. gitlab # [ 204.257410] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 711 gitlab # [ 204.260171] nixbot[2674]: {"ts": "2026-08-16T17:05:58.034Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 204.292474] nixbot[2674]: {"ts": "2026-08-16T17:05:58.069Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 204.336594] nixbot[2674]: INFO: ::ffff:127.0.0.1:56032 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 204.358079] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 50 gitlab # [ 204.361066] nixbot[2674]: {"ts": "2026-08-16T17:05:58.136Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 204.361555] nixbot[2674]: {"ts": "2026-08-16T17:05:58.137Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 204.405576] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 32 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds) gitlab # [ 204.510673] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 139 gitlab # [ 204.511817] nixbot[2674]: {"ts": "2026-08-16T17:05:58.288Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 204.636706] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 119 gitlab # [ 204.642643] nixbot[2674]: {"ts": "2026-08-16T17:05:58.414Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 204.705534] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 58 gitlab # [ 204.710488] nixbot[2674]: {"ts": "2026-08-16T17:05:58.483Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 204.793982] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 82 gitlab # [ 204.799570] nixbot[2674]: {"ts": "2026-08-16T17:05:58.576Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 204.862709] gitaly[902]: time="2026-08-16T17:05:58.638Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK2SW8JZQ7SPMVTZB7H53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T17:06:28.322" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:58.622" grpc.time_ms=15.816 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.905738] gitaly[902]: time="2026-08-16T17:05:58.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK2SW8JZQ7SPMVTZB7H53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:28.381" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:58.681" grpc.time_ms=0.709 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.939456] gitaly[902]: time="2026-08-16T17:05:58.716Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK2SW8JZQ7SPMVTZB7H53 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T17:06:08.047" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:58.707" grpc.time_ms=8.234 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 204.970420] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 158 gitlab # [ 204.972209] nixbot[2674]: {"ts": "2026-08-16T17:05:58.749Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 205.056176] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 81 gitlab # [ 205.062526] nixbot[2674]: {"ts": "2026-08-16T17:05:58.839Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 205.072117] nixbot[2674]: {"ts": "2026-08-16T17:05:58.848Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 205.163572] gitaly[902]: time="2026-08-16T17:05:58.939Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK33DCCPRNR1DP13ABYWG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:58.930" grpc.time_ms=8.713 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.167312] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 47 gitlab # [ 205.236790] gitaly[902]: time="2026-08-16T17:05:59.013Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK34YAA4S7R1VZ5FVFM54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.003" pid=902 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 205.237968] gitaly[902]: time="2026-08-16T17:05:59.013Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK34YAA4S7R1VZ5FVFM54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.003" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.238744] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 205.239784] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 71 gitlab # [ 205.240920] gitaly[902]: time="2026-08-16T17:05:59.014Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK34YAA4S7R1VZ5FVFM54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.003" grpc.time_ms=10.231 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.329713] gitaly[902]: time="2026-08-16T17:05:59.106Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK38ACG0HX8JC34KA0VCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.088" pid=902 remote_ip="2001:db8:1::1" request_sha=4c9f1d26142e5e809980b04dcf47940777383e54 response_bytes=223 span.kind=server system=grpc gitlab # [ 205.330688] gitaly[902]: time="2026-08-16T17:05:59.106Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK38ACG0HX8JC34KA0VCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.088" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.331473] gitaly[902]: time="2026-08-16T17:05:59.107Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1199 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK38ACG0HX8JC34KA0VCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.088" grpc.time_ms=18.01 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.361806] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 205.362493] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 87 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 205.466974] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 65 gitlab # [ 205.469403] gitaly[902]: time="2026-08-16T17:05:59.243Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3CA2ZPNN7EZD9N5ZGSK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.232" grpc.time_ms=11.155 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.499530] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 59 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.09 seconds) (finished: subtest: project discovered and webhook registered, in 1.16 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 205.528921] gitaly[902]: time="2026-08-16T17:05:59.305Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3ESZQS05GFA0N7D98J6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.299" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 205.537819] gitaly[902]: time="2026-08-16T17:05:59.305Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3ESZQS05GFA0N7D98J6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.299" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.549357] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 205.551043] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 50 gitlab # [ 205.553169] gitaly[902]: time="2026-08-16T17:05:59.306Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3ESZQS05GFA0N7D98J6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.299" grpc.time_ms=6.321 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.574992] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 44 gitlab # [ 205.618292] gitaly[902]: time="2026-08-16T17:05:59.395Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3HNN7JWZC1F3ENN2R3D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.386" grpc.time_ms=8.445 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.629232] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 46 gitlab # [ 205.656359] gitaly[902]: time="2026-08-16T17:05:59.433Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3HTWNC0F61554P2CWE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.423" grpc.time_ms=9.764 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 205.667283] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 80 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 205.714885] gitaly[902]: time="2026-08-16T17:05:59.491Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3K5RNA4W90J2TQZ3F7M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.479" pid=902 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 205.723746] gitaly[902]: time="2026-08-16T17:05:59.492Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3K5RNA4W90J2TQZ3F7M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.479" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.735194] gitlab-workhorse[824]: time="2026-08-16T17:05:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 205.737420] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 95 gitlab # [ 205.739100] gitaly[902]: time="2026-08-16T17:05:59.492Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1168 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3K5RNA4W90J2TQZ3F7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.479" grpc.time_ms=13.198 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 205.832321] gitaly[902]: time="2026-08-16T17:05:59.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:29.305" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:59.606" grpc.time_ms=2.449 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.879772] gitaly[902]: time="2026-08-16T17:05:59.656Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:06:29.349" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.649" grpc.time_ms=6.271 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.898840] gitaly[902]: time="2026-08-16T17:05:59.675Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:09.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.669" grpc.time_ms=5.847 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.908648] gitaly[902]: time="2026-08-16T17:05:59.685Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:09.020" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.680" grpc.time_ms=4.914 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.970861] gitaly[902]: time="2026-08-16T17:05:59.747Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:09.087" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:59.747" grpc.time_ms=0.201 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 205.986402] gitaly[902]: time="2026-08-16T17:05:59.763Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:06:09.097" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:05:59.757" grpc.time_ms=5.533 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.021524] gitaly[902]: time="2026-08-16T17:05:59.798Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:06:29.090" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:05:59.790" grpc.time_ms=7.712 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.033886] gitaly[902]: time="2026-08-16T17:05:59.807Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.806" grpc.time_ms=0.332 pid=902 span.kind=server system=grpc gitlab # [ 206.041705] gitaly[902]: time="2026-08-16T17:05:59.813Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RK3N0FWAPYMA73MHP365W duration_ms=93ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 206.050220] gitaly[902]: time="2026-08-16T17:05:59.827Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.826" grpc.time_ms=0.332 pid=902 span.kind=server system=grpc gitlab # [ 206.065407] gitaly[902]: time="2026-08-16T17:05:59.842Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ diskcache=173ab158-04e3-407b-bc00-05fa5346fda8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:09.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:59.775" pid=902 ref=refs/keep-around/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 remote_ip="2001:db8:1::1" revision=0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 span.kind=server system=grpc username=root gitlab # [ 206.066655] gitaly[902]: time="2026-08-16T17:05:59.843Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RK3N0FWAPYMA73MHP365W duration_ms=29ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 206.067461] gitaly[902]: time="2026-08-16T17:05:59.843Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.719" grpc.time_ms=123.933 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.071081] gitaly[902]: time="2026-08-16T17:05:59.848Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:29.547" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:05:59.847" grpc.time_ms=0.426 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 206.095377] gitaly[902]: time="2026-08-16T17:05:59.872Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5377 command.oublock=8 command.real_time_ms=58 command.spawn_token_fork_ms=1 command.system_time_ms=25 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:09.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:05:59.775" grpc.time_ms=66.495 pid=902 ref=refs/keep-around/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 remote_ip="2001:db8:1::1" revision=0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 span.kind=server system=grpc username=root gitlab # [ 206.122828] gitaly[902]: time="2026-08-16T17:05:59.899Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.899" grpc.time_ms=0.373 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.152593] gitaly[902]: time="2026-08-16T17:05:59.929Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.928" grpc.time_ms=0.95 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.177528] gitaly[902]: time="2026-08-16T17:05:59.954Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.953" grpc.time_ms=1.099 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.205678] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:05:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 425 gitlab # [ 206.207230] nixbot[2674]: {"ts": "2026-08-16T17:05:59.983Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab # [ 206.213792] nixbot[2674]: {"ts": "2026-08-16T17:05:59.990Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-0a07b83bc5d4-0"} gitlab # [ 206.247216] gitaly[902]: time="2026-08-16T17:06:00.024Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RK3N0FWAPYMA73MHP365W duration_ms=35ns method=POST pid=902 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 206.249935] gitaly[902]: time="2026-08-16T17:06:00.026Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:05:59.987" grpc.time_ms=38.982 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.266518] systemd[1]: Started Nix Daemon. gitlab # [ 206.270581] gitaly[902]: time="2026-08-16T17:06:00.047Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W diskcache=32749213-9bbd-4975-8eec-0f0361cc44b7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.631" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.272186] gitaly[902]: time="2026-08-16T17:06:00.048Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=126 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13154 command.oublock=32 command.real_time_ms=404 command.spawn_token_fork_ms=1 command.system_time_ms=89 command.user_time_ms=37 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:05:59.631" grpc.time_ms=416.368 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 206.273073] gitlab-workhorse[824]: time="2026-08-16T17:06:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 206.273897] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:00 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 592 gitlab # To http://gitlab/root/test-flake.git gitlab # 0a07b83..e652aaf master -> master gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.81 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 206.327538] nix-daemon[2877]: accepted connection from pid 2871, user nixbot gitlab # [ 206.368018] nixbot[2674]: INFO: ::ffff:127.0.0.1:56046 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds) gitlab # [ 206.403318] nix-daemon[2877]: accepted connection from pid 2890, user nixbot gitlab # [ 206.416692] nixbot[2674]: {"ts": "2026-08-16T17:06:00.193Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-0a07b83bc5d4-0", "argv0": "bwrap"} gitlab # [ 206.569370] nix-daemon[2877]: accepted connection from pid 2900, user nixbot gitlab # [ 206.627838] nix-daemon[2877]: accepted connection from pid 2910, user nixbot gitlab # [ 206.642529] nix-daemon[2877]: accepted connection from pid 2900, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 207.411264] nixbot[2674]: INFO: ::ffff:127.0.0.1:56056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 208.448444] nixbot[2674]: INFO: ::ffff:127.0.0.1:56058 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 209.481433] nixbot[2674]: INFO: ::ffff:127.0.0.1:56064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 210.516544] nixbot[2674]: INFO: ::ffff:127.0.0.1:56068 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 210.872707] nix-daemon[2877]: accepted connection from pid 2935, user nixbot gitlab # [ 210.891852] gitaly[902]: time="2026-08-16T17:06:04.668Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK8PE6P23PGZXJJGB4FE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:34.367" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:04.667" grpc.time_ms=0.512 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.918782] gitaly[902]: time="2026-08-16T17:06:04.695Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK8PE6P23PGZXJJGB4FE0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:14.027" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:04.687" grpc.time_ms=8.248 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 210.955499] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 108 gitlab # [ 210.958708] nixbot[2674]: {"ts": "2026-08-16T17:06:04.735Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab # [ 211.018665] gitaly[902]: time="2026-08-16T17:06:04.795Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK8T5HYM4HVT2D5BV92ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:34.094" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:04.794" grpc.time_ms=0.896 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 211.090943] gitaly[902]: time="2026-08-16T17:06:04.867Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK8T5HYM4HVT2D5BV92ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:14.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:04.858" grpc.time_ms=8.708 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 211.182567] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 217 gitlab # [ 211.183633] nixbot[2674]: {"ts": "2026-08-16T17:06:04.960Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 211.550529] nixbot[2674]: INFO: ::ffff:127.0.0.1:56082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 212.585752] nixbot[2674]: INFO: ::ffff:127.0.0.1:56084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 213.625420] nixbot[2674]: INFO: ::ffff:127.0.0.1:55900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 214.665521] nixbot[2674]: INFO: ::ffff:127.0.0.1:55910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 215.550656] nix-daemon[2877]: accepted connection from pid 2980, user nixbot gitlab # [ 215.628938] gitaly[902]: time="2026-08-16T17:06:09.405Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDAAT3D789661BT955BX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:06:39.004" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:09.404" grpc.time_ms=0.781 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 215.670602] gitaly[902]: time="2026-08-16T17:06:09.447Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RKDAAT3D789661BT955BX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:19.088" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:09.438" grpc.time_ms=8.571 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 215.697772] nixbot[2674]: INFO: ::ffff:127.0.0.1:55916 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 215.716255] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 137 gitlab # [ 215.716968] nixbot[2674]: {"ts": "2026-08-16T17:06:09.493Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab # [ 215.786917] nix-daemon[2877]: accepted connection from pid 2997, user nixbot gitlab # [ 215.875061] gitaly[902]: time="2026-08-16T17:06:09.651Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RKDJ7C4K985WSEKP8ZCB7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.643" grpc.time_ms=8.314 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 215.875726] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 45 gitlab # [ 215.931231] gitaly[902]: time="2026-08-16T17:06:09.708Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDKPA1TC1C33F9K0G953 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.701" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 215.932089] gitaly[902]: time="2026-08-16T17:06:09.708Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDKPA1TC1C33F9K0G953 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.701" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 215.932765] gitaly[902]: time="2026-08-16T17:06:09.708Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDKPA1TC1C33F9K0G953 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.701" grpc.time_ms=7.216 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 215.962463] gitlab-workhorse[824]: time="2026-08-16T17:06:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 215.963646] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 85 gitlab # [ 216.025740] gitaly[902]: time="2026-08-16T17:06:09.802Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDPFR5G0V1ZYZYH12CE2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.786" pid=902 remote_ip="2001:db8:1::1" request_sha=8c588c7e5c1cdfd3e8806a34b03a3afc2ebff7f3 response_bytes=337 span.kind=server system=grpc gitlab # [ 216.026781] gitaly[902]: time="2026-08-16T17:06:09.802Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDPFR5G0V1ZYZYH12CE2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.786" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 216.050544] gitaly[902]: time="2026-08-16T17:06:09.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1194 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RKDPFR5G0V1ZYZYH12CE2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:09.786" grpc.time_ms=41.368 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 216.051359] gitlab-workhorse[824]: time="2026-08-16T17:06:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 216.052038] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 84 gitlab # [ 216.159866] nix-daemon[2877]: accepted connection from pid 3027, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 216.736147] nixbot[2674]: INFO: ::ffff:127.0.0.1:55932 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 217.775155] nixbot[2674]: INFO: ::ffff:127.0.0.1:55946 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 218.810899] nixbot[2674]: INFO: ::ffff:127.0.0.1:55948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 219.848254] nixbot[2674]: INFO: ::ffff:127.0.0.1:55952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 220.884433] nixbot[2674]: INFO: ::ffff:127.0.0.1:55960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 221.919785] nixbot[2674]: INFO: ::ffff:127.0.0.1:55968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 222.956544] nixbot[2674]: INFO: ::ffff:127.0.0.1:55982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 223.996388] nixbot[2674]: INFO: ::ffff:127.0.0.1:45010 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 225.033220] nixbot[2674]: INFO: ::ffff:127.0.0.1:45026 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 226.069141] nixbot[2674]: INFO: ::ffff:127.0.0.1:45040 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 227.108657] nixbot[2674]: INFO: ::ffff:127.0.0.1:45050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 227.264596] sidekiq-cluster[2616]: 2026-08-16T17:06:21.040Z pid=2616 tid=xao INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2616, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>448749568} gitlab # [ 227.436935] sidekiq-cluster[2616]: W, [2026-08-16T17:06:21.213552 #2616] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 227.474979] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:21.251Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 228.145763] nixbot[2674]: INFO: ::ffff:127.0.0.1:45054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 229.180863] nixbot[2674]: INFO: ::ffff:127.0.0.1:45062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 229.319347] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:23.095Z","message":"GitLab reliable fetch activated!"} gitlab # [ 229.322879] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:23.095Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 230.205843] nixbot[2674]: INFO: ::ffff:127.0.0.1:45070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 231.239163] nixbot[2674]: INFO: ::ffff:127.0.0.1:45082 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 232.275681] nixbot[2674]: INFO: ::ffff:127.0.0.1:45090 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 233.310943] nixbot[2674]: INFO: ::ffff:127.0.0.1:53586 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 234.335034] nixbot[2674]: INFO: ::ffff:127.0.0.1:53594 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 235.369443] nixbot[2674]: INFO: ::ffff:127.0.0.1:53610 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 236.406169] nixbot[2674]: INFO: ::ffff:127.0.0.1:53620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 237.442656] nixbot[2674]: INFO: ::ffff:127.0.0.1:53632 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 238.479351] nixbot[2674]: INFO: ::ffff:127.0.0.1:53638 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 239.503991] nixbot[2674]: INFO: ::ffff:127.0.0.1:53640 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.02 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 240.535753] nixbot[2674]: INFO: ::ffff:127.0.0.1:53644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 241.569352] nixbot[2674]: INFO: ::ffff:127.0.0.1:53652 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 242.605405] nixbot[2674]: INFO: ::ffff:127.0.0.1:53660 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 243.641141] nixbot[2674]: INFO: ::ffff:127.0.0.1:50788 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 244.677559] nixbot[2674]: INFO: ::ffff:127.0.0.1:50792 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 245.714924] nixbot[2674]: INFO: ::ffff:127.0.0.1:50800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 246.751360] nixbot[2674]: INFO: ::ffff:127.0.0.1:50816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 247.779661] nixbot[2674]: INFO: ::ffff:127.0.0.1:50832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 248.823148] nixbot[2674]: INFO: ::ffff:127.0.0.1:50844 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds) gitlab # [ 249.814638] postgres[3149]: [3149] ERROR: relation "table_without_models" does not exist gitlab # [ 249.817351] postgres[3149]: [3149] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 249.859646] nixbot[2674]: INFO: ::ffff:127.0.0.1:50852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 250.895541] nixbot[2674]: INFO: ::ffff:127.0.0.1:50866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 251.932126] nixbot[2674]: INFO: ::ffff:127.0.0.1:50880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 252.238235] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.014Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 252.241909] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.016Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"} gitlab # [ 252.246214] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.016Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 252.250052] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.016Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 252.254415] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:46.017Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 252.967975] nixbot[2674]: INFO: ::ffff:127.0.0.1:50888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 253.782451] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.558Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f186cf1d1ef16e9586b4221c","created_at":"2026-08-16T17:05:53.214Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.252Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f186cf1d1ef16e9586b4221c: start","job_status":"start","queue_duration_s":54.305333,"scheduling_latency_s":54.305402} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.06 seconds) gitlab # [ 253.989974] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.766Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"f186cf1d1ef16e9586b4221c","created_at":"2026-08-16T17:05:53.214Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.252Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-f186cf1d1ef16e9586b4221c: done: 0.208167 sec","job_status":"done","queue_duration_s":54.305333,"scheduling_latency_s":54.305402,"redis_calls":23,"redis_duration_s":0.009236,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.00409,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003464,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001682,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.101462337,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.208167,"completed_at":"2026-08-16T17:06:47.766Z","load_balancing_strategy":"primary","db_duration_s":0.063617,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.057926] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.770Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"7ba84f02cc931c7f8497acef","created_at":"2026-08-16T17:05:53.272Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.280Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-7ba84f02cc931c7f8497acef: start","job_status":"start","queue_duration_s":54.489523,"scheduling_latency_s":54.489577} gitlab # [ 254.058792] nixbot[2674]: INFO: ::ffff:127.0.0.1:43828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab # [ 254.122683] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.898Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"7ba84f02cc931c7f8497acef","created_at":"2026-08-16T17:05:53.272Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.280Z","job_size_bytes":2,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-7ba84f02cc931c7f8497acef: done: 0.128576 sec","job_status":"done","queue_duration_s":54.489523,"scheduling_latency_s":54.489577,"redis_calls":14,"redis_duration_s":0.004178,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00114,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001278,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.090256443,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.128576,"completed_at":"2026-08-16T17:06:47.898Z","load_balancing_strategy":"primary","db_duration_s":0.023656,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.125353] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:47.901Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8f78a4150abc143791c3114c","created_at":"2026-08-16T17:05:53.924Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.929Z","job_size_bytes":5,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8f78a4150abc143791c3114c: start","job_status":"start","queue_duration_s":53.971205,"scheduling_latency_s":53.971237} gitlab # [ 254.268134] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.044Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"8f78a4150abc143791c3114c","created_at":"2026-08-16T17:05:53.924Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.929Z","job_size_bytes":5,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-8f78a4150abc143791c3114c: done: 0.143562 sec","job_status":"done","queue_duration_s":53.971205,"scheduling_latency_s":53.971237,"redis_calls":12,"redis_duration_s":0.003255,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000843,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001895,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000325181,"duration_s":0.143562,"completed_at":"2026-08-16T17:06:48.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02581,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 254.270557] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.046Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"04511173a01a01beb9aa8938","created_at":"2026-08-16T17:05:53.952Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.955Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-04511173a01a01beb9aa8938: start","job_status":"start","queue_duration_s":54.090268,"scheduling_latency_s":54.090284} gitlab # [ 254.440294] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.216Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"04511173a01a01beb9aa8938","created_at":"2026-08-16T17:05:53.952Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.955Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-04511173a01a01beb9aa8938: done: 0.170756 sec","job_status":"done","queue_duration_s":54.090268,"scheduling_latency_s":54.090284,"redis_calls":11,"redis_duration_s":0.00248,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.144,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.144,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029892,"duration_s":0.170756,"completed_at":"2026-08-16T17:06:48.216Z","load_balancing_strategy":"primary","db_duration_s":0.06161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.443475] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.218Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9ecb16d656ebad4d8ab42171","created_at":"2026-08-16T17:05:53.958Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.961Z","job_size_bytes":89,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9ecb16d656ebad4d8ab42171: start","job_status":"start","queue_duration_s":54.256769,"scheduling_latency_s":54.256783} gitlab # [ 254.521339] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.245Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"9ecb16d656ebad4d8ab42171","created_at":"2026-08-16T17:05:53.958Z","trace_propagation_headers":{"sentry-trace":"49c20794c59f43e29be268334f477deb-7f6d1f84e6624ba7","baggage":"sentry-trace_id=49c20794c59f43e29be268334f477deb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJWFPC8SWXJJSV1J5HHTZ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:53.961Z","job_size_bytes":89,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-9ecb16d656ebad4d8ab42171: done: 0.027289 sec","job_status":"done","queue_duration_s":54.256769,"scheduling_latency_s":54.256783,"redis_calls":11,"redis_duration_s":0.002463,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000717,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000439,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000288863,"duration_s":0.027289,"completed_at":"2026-08-16T17:06:48.245Z","load_balancing_strategy":"primary","db_duration_s":0.005382,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.529297] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.246Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"42d7c5e669a6dbfe555c9cd5","created_at":"2026-08-16T17:05:55.618Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-12ff30c695fa443f","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:55.641Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-42d7c5e669a6dbfe555c9cd5: start","job_status":"start","queue_duration_s":52.605693,"scheduling_latency_s":52.605708} gitlab # [ 254.573803] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:48.258Z","message":"changes: \"0000000000000000000000000000000000000000 0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 refs/heads/master\\n\""} gitlab # [ 254.575044] gitaly[902]: time="2026-08-16T17:06:48.301Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:58.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.293" grpc.time_ms=8.026 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.575691] gitaly[902]: time="2026-08-16T17:06:48.313Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:58.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.307" grpc.time_ms=5.728 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.584842] gitaly[902]: time="2026-08-16T17:06:48.361Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:06:58.063" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.354" grpc.time_ms=7.484 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.627580] gitaly[902]: time="2026-08-16T17:06:48.404Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:48.403" grpc.time_ms=0.527 pid=902 span.kind=server system=grpc gitlab # [ 254.654732] gitaly[902]: time="2026-08-16T17:06:48.431Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:48.431" grpc.time_ms=0.452 pid=902 span.kind=server system=grpc gitlab # [ 254.669744] gitaly[902]: time="2026-08-16T17:06:48.446Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C diskcache=5e508166-f710-472f-b403-a27ffbad5dbc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:58.080" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.370" pid=902 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 254.670413] gitaly[902]: time="2026-08-16T17:06:48.446Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5094 command.oublock=8 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=27 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:58.080" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.370" grpc.time_ms=76.111 pid=902 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 254.702677] gitaly[902]: time="2026-08-16T17:06:48.479Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:58.188" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.479" grpc.time_ms=0.228 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.719819] gitaly[902]: time="2026-08-16T17:06:48.496Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:06:58.192" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.483" grpc.time_ms=13.396 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.798534] gitaly[902]: time="2026-08-16T17:06:48.575Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T17:07:18.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:48.568" grpc.time_ms=6.47 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.832206] gitaly[902]: time="2026-08-16T17:06:48.609Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:58.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:48.608" grpc.time_ms=0.171 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.848450] gitaly[902]: time="2026-08-16T17:06:48.625Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:06:58.018" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:06:48.618" grpc.time_ms=6.623 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.873251] gitaly[902]: time="2026-08-16T17:06:48.650Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:58.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.642" grpc.time_ms=7.344 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.890142] gitaly[902]: time="2026-08-16T17:06:48.666Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:58.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:48.655" grpc.time_ms=11.076 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 254.918669] gitaly[902]: time="2026-08-16T17:06:48.695Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:07:18.180" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:48.680" grpc.time_ms=15.023 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 255.076970] nixbot[2674]: INFO: ::ffff:127.0.0.1:43842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab # [ 255.269551] gitaly[902]: time="2026-08-16T17:06:49.046Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:06:59.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.045" grpc.time_ms=1.038 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.309610] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.085Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"42d7c5e669a6dbfe555c9cd5","created_at":"2026-08-16T17:05:55.618Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-12ff30c695fa443f","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:55.641Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-42d7c5e669a6dbfe555c9cd5: done: 0.838606 sec","job_status":"done","queue_duration_s":52.605693,"scheduling_latency_s":52.605708,"gitaly_calls":13,"gitaly_duration_s":0.255847,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.04584,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.003804,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006397,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001504,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002841,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.016238,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015056,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.18,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.202,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.051,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.473933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000533308,"exclusive_lock_hold_duration_s":0.038041986,"duration_s":0.838606,"completed_at":"2026-08-16T17:06:49.085Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.089089,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.351928] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.128Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"905512038a8af718ba18909c","created_at":"2026-08-16T17:05:59.853Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.858Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-905512038a8af718ba18909c: start","job_status":"start","queue_duration_s":49.269927,"scheduling_latency_s":49.269952} gitlab # [ 255.470336] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.246Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"905512038a8af718ba18909c","created_at":"2026-08-16T17:05:59.853Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.858Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-905512038a8af718ba18909c: done: 0.118152 sec","job_status":"done","queue_duration_s":49.269927,"scheduling_latency_s":49.269952,"redis_calls":16,"redis_duration_s":0.004665,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002512,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001574,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000461512,"duration_s":0.118152,"completed_at":"2026-08-16T17:06:49.246Z","load_balancing_strategy":"primary","db_duration_s":0.023229,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 255.472057] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.248Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9a653ab125a8f37890020cf","created_at":"2026-08-16T17:05:59.858Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.874Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9a653ab125a8f37890020cf: start","job_status":"start","queue_duration_s":49.373781,"scheduling_latency_s":49.373796} gitlab # [ 255.620932] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.396Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b9a653ab125a8f37890020cf","created_at":"2026-08-16T17:05:59.858Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.874Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b9a653ab125a8f37890020cf: done: 0.148435 sec","job_status":"done","queue_duration_s":49.373781,"scheduling_latency_s":49.373796,"redis_calls":21,"redis_duration_s":0.004962,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002028,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277409,"duration_s":0.148435,"completed_at":"2026-08-16T17:06:49.396Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.622969] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.398Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8abf965ef23ecf012ced8059","created_at":"2026-08-16T17:05:59.965Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.970Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8abf965ef23ecf012ced8059: start","job_status":"start","queue_duration_s":49.427833,"scheduling_latency_s":49.427848} gitlab # [ 255.783716] gitaly[902]: time="2026-08-16T17:06:49.559Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:49.559" grpc.time_ms=0.285 pid=902 span.kind=server system=grpc gitlab # [ 255.809331] gitaly[902]: time="2026-08-16T17:06:49.586Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:49.585" grpc.time_ms=0.274 pid=902 span.kind=server system=grpc gitlab # [ 255.846514] gitaly[902]: time="2026-08-16T17:06:49.623Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:49.623" grpc.time_ms=0.246 pid=902 span.kind=server system=grpc gitlab # [ 255.862279] gitaly[902]: time="2026-08-16T17:06:49.639Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ diskcache=875c8aec-dfb8-4495-95d8-9d480f32ffab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:19.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.533" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.863216] gitaly[902]: time="2026-08-16T17:06:49.639Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=119 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7437 command.oublock=0 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=76 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:19.032" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.533" grpc.time_ms=105.853 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 255.971951] gitaly[902]: time="2026-08-16T17:06:49.748Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:19.247" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.747" grpc.time_ms=1.101 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.000838] gitaly[902]: time="2026-08-16T17:06:49.777Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3R5ENQVXPRBS73Y3SKQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:19.276" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.776" grpc.time_ms=0.978 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.026614] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.803Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8abf965ef23ecf012ced8059","created_at":"2026-08-16T17:05:59.965Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.970Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2616,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8abf965ef23ecf012ced8059: rescheduled"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 256.051070] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.827Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8abf965ef23ecf012ced8059","created_at":"2026-08-16T17:05:59.965Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-e7824d5b3bd043bb","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:59.970Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8abf965ef23ecf012ced8059: done: 0.428462 sec","job_status":"done","queue_duration_s":49.427833,"scheduling_latency_s":49.427848,"gitaly_calls":3,"gitaly_duration_s":0.124138,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.036878,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001379,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001086,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.009322,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003987,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.015932,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000693,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000659,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002441,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.024,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.027,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.203865,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.361026331,"duration_s":0.428462,"completed_at":"2026-08-16T17:06:49.827Z","load_balancing_strategy":"primary","db_duration_s":0.069258,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.096894] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.873Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 e652aafceb871cb9d38ca62ebe5294ea158d1c90 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"506f6ed4588a3362df0234e4","created_at":"2026-08-16T17:06:00.009Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-aa35811c30524c94","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:00.010Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-506f6ed4588a3362df0234e4: start","job_status":"start","queue_duration_s":49.862386,"scheduling_latency_s":49.862429} gitlab # [ 256.114207] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.890Z","message":"changes: \"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 e652aafceb871cb9d38ca62ebe5294ea158d1c90 refs/heads/master\\n\""} gitlab # [ 256.116844] nixbot[2674]: INFO: ::ffff:127.0.0.1:43846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 256.152126] gitaly[902]: time="2026-08-16T17:06:49.929Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:59.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.918" grpc.time_ms=10.596 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.171696] gitaly[902]: time="2026-08-16T17:06:49.948Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:59.030" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:49.940" grpc.time_ms=7.973 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.183144] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:49.953Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"cbd439db6ebf73c73481797d","created_at":"2026-08-16T17:06:49.951Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"a876f54a1f8cc6ee8261a35d","job_size_bytes":46,"pid":2616,"job_status":"deduplicated","message":"ProjectCacheWorker JID-cbd439db6ebf73c73481797d: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 256.202363] gitaly[902]: time="2026-08-16T17:06:49.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:06:59.058" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:49.968" grpc.time_ms=10.367 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.215905] gitaly[902]: time="2026-08-16T17:06:49.992Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T17:07:19.482" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:49.983" grpc.time_ms=9.316 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.235917] gitaly[902]: time="2026-08-16T17:06:50.012Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:07:00.005" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:06:50.005" grpc.time_ms=6.75 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.253745] gitaly[902]: time="2026-08-16T17:06:50.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:00.020" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:50.021" grpc.time_ms=9.476 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.358949] gitaly[902]: time="2026-08-16T17:06:50.135Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:07:00.133" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.134" grpc.time_ms=1.327 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.389115] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.164Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 e652aafceb871cb9d38ca62ebe5294ea158d1c90 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"506f6ed4588a3362df0234e4","created_at":"2026-08-16T17:06:00.009Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-aa35811c30524c94","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:00.010Z","job_size_bytes":185,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-506f6ed4588a3362df0234e4: done: 0.291491 sec","job_status":"done","queue_duration_s":49.862386,"scheduling_latency_s":49.862429,"gitaly_calls":7,"gitaly_duration_s":0.094754,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.023411,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.002428,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001091,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003517,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008128,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.008247,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.155151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000867708,"exclusive_lock_hold_duration_s":0.022958784,"duration_s":0.291491,"completed_at":"2026-08-16T17:06:50.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031401,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.398487] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.166Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a876f54a1f8cc6ee8261a35d","created_at":"2026-08-16T17:06:48.315Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.331Z","job_size_bytes":46,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a876f54a1f8cc6ee8261a35d: start","job_status":"start","queue_duration_s":1.835207,"scheduling_latency_s":1.835238} gitlab # [ 256.462367] gitaly[902]: time="2026-08-16T17:06:50.239Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T23:06:50.233" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:50.233" grpc.time_ms=5.047 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.486513] gitaly[902]: time="2026-08-16T17:06:50.263Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:07:20.050" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.251" grpc.time_ms=11.441 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.518354] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.294Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"a876f54a1f8cc6ee8261a35d","created_at":"2026-08-16T17:06:48.315Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.331Z","job_size_bytes":46,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a876f54a1f8cc6ee8261a35d: done: 0.128138 sec","job_status":"done","queue_duration_s":1.835207,"scheduling_latency_s":1.835238,"gitaly_calls":2,"gitaly_duration_s":0.051942,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007656,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001501,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000672,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001906,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002815,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000425193,"duration_s":0.128138,"completed_at":"2026-08-16T17:06:50.294Z","load_balancing_strategy":"primary","db_duration_s":0.012509,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.538187] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.296Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba6c27110cd7d9ec53e7cc86","created_at":"2026-08-16T17:06:48.346Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.350Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba6c27110cd7d9ec53e7cc86: start","job_status":"start","queue_duration_s":1.946193,"scheduling_latency_s":1.946209} gitlab # [ 256.565702] gitaly[902]: time="2026-08-16T17:06:50.342Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C diskcache=73c1245e-9f91-4814-899a-ea15246eceac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:50.315" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.316" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.566857] gitaly[902]: time="2026-08-16T17:06:50.342Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1289 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:50.315" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.316" grpc.time_ms=26.491 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.623478] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.400Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba6c27110cd7d9ec53e7cc86","created_at":"2026-08-16T17:06:48.346Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.350Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba6c27110cd7d9ec53e7cc86: done: 0.103718 sec","job_status":"done","queue_duration_s":1.946193,"scheduling_latency_s":1.946209,"gitaly_calls":1,"gitaly_duration_s":0.0555,"redis_calls":15,"redis_duration_s":0.003725,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000619,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001216,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.016,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.08489375,"duration_s":0.103718,"completed_at":"2026-08-16T17:06:50.400Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.625966] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.401Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"853633179b9ab57d3f66ae84","created_at":"2026-08-16T17:06:48.474Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.476Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-853633179b9ab57d3f66ae84: start","job_status":"start","queue_duration_s":1.92509,"scheduling_latency_s":1.925105} gitlab # [ 256.655601] gitaly[902]: time="2026-08-16T17:06:50.432Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:07:20.220" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.421" grpc.time_ms=10.865 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.668104] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.444Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"853633179b9ab57d3f66ae84","created_at":"2026-08-16T17:06:48.474Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.476Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-853633179b9ab57d3f66ae84: done: 0.042353 sec","job_status":"done","queue_duration_s":1.92509,"scheduling_latency_s":1.925105,"gitaly_calls":1,"gitaly_duration_s":0.012889,"redis_calls":16,"redis_duration_s":0.004377,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000392,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001937,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042353,"completed_at":"2026-08-16T17:06:50.443Z","load_balancing_strategy":"primary","db_duration_s":0.002663,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 256.711527] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:50.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"12574554f6e7b648e4be2e32","created_at":"2026-08-16T17:06:48.925Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:780f8c7d20af01a4cf5765d0b60205d590694527dd808288c6f36e14c77f1773","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.929Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-12574554f6e7b648e4be2e32: start","job_status":"start","queue_duration_s":1.516996,"scheduling_latency_s":1.51703} gitlab # [ 256.712569] gitaly[902]: time="2026-08-16T17:06:50.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:20.277" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.478" grpc.time_ms=0.673 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.713395] gitaly[902]: time="2026-08-16T17:06:50.489Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:07:00.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:50.480" grpc.time_ms=8.701 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.790442] gitaly[902]: time="2026-08-16T17:06:50.566Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:20.364" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.565" grpc.time_ms=1.009 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.804268] gitaly[902]: time="2026-08-16T17:06:50.581Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=61 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:07:20.378" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:50.578" grpc.time_ms=2.438 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 256.888439] gitaly[902]: time="2026-08-16T17:06:50.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:00.174" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:50.655" grpc.time_ms=10.021 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 257.163226] nixbot[2674]: INFO: ::ffff:127.0.0.1:43856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds) gitlab # [ 257.258069] gitaly[902]: time="2026-08-16T17:06:51.034Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:07:21.018" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.019" grpc.time_ms=15.223 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.303858] gitaly[902]: time="2026-08-16T17:06:51.080Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RJZCD21JKPFK9SA7DGA9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:07:21.069" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.069" grpc.time_ms=11.13 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 257.327104] sidekiq-cluster[2616]: {"severity":"WARN","time":"2026-08-16T17:06:51.103Z","class":"CreatePipelineWorker","correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926","ref":"refs/heads/master"},"retry":0} gitlab # [ 257.332571] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.109Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"12574554f6e7b648e4be2e32","created_at":"2026-08-16T17:06:48.925Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:780f8c7d20af01a4cf5765d0b60205d590694527dd808288c6f36e14c77f1773","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:48.929Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-12574554f6e7b648e4be2e32: done: 0.662866 sec","job_status":"done","queue_duration_s":1.516996,"scheduling_latency_s":1.51703,"gitaly_calls":7,"gitaly_duration_s":0.105837,"redis_calls":51,"redis_duration_s":0.009033,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000724,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003411,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001243,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00252,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.505572,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002816,"duration_s":0.662866,"completed_at":"2026-08-16T17:06:51.109Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040807,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.340200] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.110Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"9b6bc551-6b56-46ef-82f5-3a1c6dbd7030\"}"],"class":"WebHookWorker","jid":"dc614e3d8dea584cecbf3ece","created_at":"2026-08-16T17:06:49.020Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d41de798733e3a622cfdf3a9c871978ceaf2ca539bc5ea04100ce11f3ce03d1","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.025Z","job_size_bytes":1751,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dc614e3d8dea584cecbf3ece: start","job_status":"start","queue_duration_s":2.084881,"scheduling_latency_s":2.084895} gitlab # [ 257.460625] nixbot[2674]: INFO: ::ffff:127.0.0.1:43868 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 257.485068] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.260Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"9b6bc551-6b56-46ef-82f5-3a1c6dbd7030\"}"],"class":"WebHookWorker","jid":"dc614e3d8dea584cecbf3ece","created_at":"2026-08-16T17:06:49.020Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-27faf78365484e23","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d41de798733e3a622cfdf3a9c871978ceaf2ca539bc5ea04100ce11f3ce03d1","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.025Z","job_size_bytes":1751,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dc614e3d8dea584cecbf3ece: done: 0.149843 sec","job_status":"done","queue_duration_s":2.084881,"scheduling_latency_s":2.084895,"redis_calls":19,"redis_duration_s":0.004335,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001316,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00037,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00176,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04586588499995514,"cpu_s":0.087778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000584432,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.149843,"completed_at":"2026-08-16T17:06:51.260Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.545750] gitaly[902]: time="2026-08-16T17:06:51.309Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMP7WCC0ER8JHRJ20AXDX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.299" grpc.time_ms=9.948 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 257.547134] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 49 gitlab # [ 257.562497] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.338Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"439eafb0c68010c5de389d87","created_at":"2026-08-16T17:06:49.521Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.525Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-439eafb0c68010c5de389d87: start","job_status":"start","queue_duration_s":1.813214,"scheduling_latency_s":1.813262} gitlab # [ 257.678619] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"439eafb0c68010c5de389d87","created_at":"2026-08-16T17:06:49.521Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.525Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-439eafb0c68010c5de389d87: done: 0.116021 sec","job_status":"done","queue_duration_s":1.813214,"scheduling_latency_s":1.813262,"redis_calls":10,"redis_duration_s":0.002888,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.086747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000569347,"duration_s":0.116021,"completed_at":"2026-08-16T17:06:51.454Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017316,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 257.724926] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.457Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d5acb6208d3ace0abf2d6b2","created_at":"2026-08-16T17:06:49.647Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.654Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d5acb6208d3ace0abf2d6b2: start","job_status":"start","queue_duration_s":1.802429,"scheduling_latency_s":1.802466} gitlab # [ 257.726430] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.496Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2d5acb6208d3ace0abf2d6b2","created_at":"2026-08-16T17:06:49.647Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.654Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2d5acb6208d3ace0abf2d6b2: done: 0.038988 sec","job_status":"done","queue_duration_s":1.802429,"scheduling_latency_s":1.802466,"redis_calls":10,"redis_duration_s":0.002174,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000600355,"duration_s":0.038988,"completed_at":"2026-08-16T17:06:51.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004097,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.767979] gitaly[902]: time="2026-08-16T17:06:51.501Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMP9GCFAA45X6AKFB1JDW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.492" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 257.768525] gitlab-workhorse[824]: time="2026-08-16T17:06:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 257.770085] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 165 gitlab # [ 257.771571] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d3baee44be9afa4920fa9104","created_at":"2026-08-16T17:06:49.671Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.677Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d3baee44be9afa4920fa9104: start","job_status":"start","queue_duration_s":1.819849,"scheduling_latency_s":1.819865} gitlab # [ 257.784847] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d3baee44be9afa4920fa9104","created_at":"2026-08-16T17:06:49.671Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.677Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d3baee44be9afa4920fa9104: done: 0.025872 sec","job_status":"done","queue_duration_s":1.819849,"scheduling_latency_s":1.819865,"redis_calls":10,"redis_duration_s":0.002533,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000316,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000335,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212317,"duration_s":0.025872,"completed_at":"2026-08-16T17:06:51.523Z","load_balancing_strategy":"primary","db_duration_s":0.003339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.825529] gitaly[902]: time="2026-08-16T17:06:51.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMP9GCFAA45X6AKFB1JDW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.492" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 257.830596] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.524Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e48f6d9f7d8adb8eda4a4862","created_at":"2026-08-16T17:06:49.694Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.699Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e48f6d9f7d8adb8eda4a4862: start","job_status":"start","queue_duration_s":1.82487,"scheduling_latency_s":1.824883} gitlab # [ 257.868991] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.582Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"e48f6d9f7d8adb8eda4a4862","created_at":"2026-08-16T17:06:49.694Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.699Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e48f6d9f7d8adb8eda4a4862: done: 0.057848 sec","job_status":"done","queue_duration_s":1.82487,"scheduling_latency_s":1.824883,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000361,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019835,"duration_s":0.057848,"completed_at":"2026-08-16T17:06:51.582Z","load_balancing_strategy":"primary","db_duration_s":0.00298,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.906385] gitaly[902]: time="2026-08-16T17:06:51.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMP9GCFAA45X6AKFB1JDW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:51.492" grpc.time_ms=8.816 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 257.907151] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.583Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e98661c227488f7f5851a026","created_at":"2026-08-16T17:06:49.700Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.704Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e98661c227488f7f5851a026: start","job_status":"start","queue_duration_s":1.878691,"scheduling_latency_s":1.878764} gitlab # [ 257.907681] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e98661c227488f7f5851a026","created_at":"2026-08-16T17:06:49.700Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.704Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e98661c227488f7f5851a026: done: 0.027259 sec","job_status":"done","queue_duration_s":1.878691,"scheduling_latency_s":1.878764,"redis_calls":10,"redis_duration_s":0.00623,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000234108,"duration_s":0.027259,"completed_at":"2026-08-16T17:06:51.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.961550] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.612Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d38e6451db85fc10c83b957","created_at":"2026-08-16T17:06:49.705Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.708Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d38e6451db85fc10c83b957: start","job_status":"start","queue_duration_s":1.903444,"scheduling_latency_s":1.903457} gitlab # [ 257.962121] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"2d38e6451db85fc10c83b957","created_at":"2026-08-16T17:06:49.705Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.708Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-2d38e6451db85fc10c83b957: done: 0.018469 sec","job_status":"done","queue_duration_s":1.903444,"scheduling_latency_s":1.903457,"redis_calls":11,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000239,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254222,"duration_s":0.018469,"completed_at":"2026-08-16T17:06:51.630Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.005956] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.631Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b1993cf002c4b514f5e86336","created_at":"2026-08-16T17:06:49.710Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.713Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b1993cf002c4b514f5e86336: start","job_status":"start","queue_duration_s":1.917785,"scheduling_latency_s":1.917798} gitlab # [ 258.006543] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.672Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"b1993cf002c4b514f5e86336","created_at":"2026-08-16T17:06:49.710Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.713Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-b1993cf002c4b514f5e86336: done: 0.040832 sec","job_status":"done","queue_duration_s":1.917785,"scheduling_latency_s":1.917798,"redis_calls":10,"redis_duration_s":0.001559,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000250311,"duration_s":0.040832,"completed_at":"2026-08-16T17:06:51.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.057271] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"139ff9ddbe72332d5f158166","created_at":"2026-08-16T17:06:49.714Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.717Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-139ff9ddbe72332d5f158166: start","job_status":"start","queue_duration_s":1.95638,"scheduling_latency_s":1.956394} gitlab # [ 258.057935] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"139ff9ddbe72332d5f158166","created_at":"2026-08-16T17:06:49.714Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.717Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-139ff9ddbe72332d5f158166: done: 0.029723 sec","job_status":"done","queue_duration_s":1.95638,"scheduling_latency_s":1.956394,"redis_calls":10,"redis_duration_s":0.001528,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00025,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000228521,"duration_s":0.029723,"completed_at":"2026-08-16T17:06:51.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.095635] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.704Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"69b6c64de8dc04f624759af3","created_at":"2026-08-16T17:06:49.721Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.724Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-69b6c64de8dc04f624759af3: start","job_status":"start","queue_duration_s":1.979543,"scheduling_latency_s":1.979557} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 258.099661] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.727Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"69b6c64de8dc04f624759af3","created_at":"2026-08-16T17:06:49.721Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.724Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-69b6c64de8dc04f624759af3: done: 0.022938 sec","job_status":"done","queue_duration_s":1.979543,"scheduling_latency_s":1.979557,"redis_calls":10,"redis_duration_s":0.001289,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214274,"duration_s":0.022938,"completed_at":"2026-08-16T17:06:51.726Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.155513] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.728Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b27bc6ec43944f527cc1fd7e","created_at":"2026-08-16T17:06:49.724Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.727Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b27bc6ec43944f527cc1fd7e: start","job_status":"start","queue_duration_s":2.000404,"scheduling_latency_s":2.000417} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.03 seconds) gitlab # [ 258.156206] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.741Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b27bc6ec43944f527cc1fd7e","created_at":"2026-08-16T17:06:49.724Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.727Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b27bc6ec43944f527cc1fd7e: done: 0.013915 sec","job_status":"done","queue_duration_s":2.000404,"scheduling_latency_s":2.000417,"redis_calls":10,"redis_duration_s":0.001299,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000234,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277968,"duration_s":0.013915,"completed_at":"2026-08-16T17:06:51.741Z","load_balancing_strategy":"primary","db_duration_s":0.001269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.195562] gitaly[902]: time="2026-08-16T17:06:51.930Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W diskcache=9e8139fe-7945-4795-95c5-0218054c29b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:51.921" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.922" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.196224] gitaly[902]: time="2026-08-16T17:06:51.931Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:06:51.921" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.922" grpc.time_ms=8.936 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.233595] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3587fc1a4e815110ef8d575a","created_at":"2026-08-16T17:06:49.728Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.730Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3587fc1a4e815110ef8d575a: start","job_status":"start","queue_duration_s":2.012245,"scheduling_latency_s":2.012258} gitlab # [ 258.234233] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.841Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"3587fc1a4e815110ef8d575a","created_at":"2026-08-16T17:06:49.728Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.730Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-3587fc1a4e815110ef8d575a: done: 0.098512 sec","job_status":"done","queue_duration_s":2.012245,"scheduling_latency_s":2.012258,"redis_calls":10,"redis_duration_s":0.00125,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000237,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019388,"duration_s":0.098512,"completed_at":"2026-08-16T17:06:51.841Z","load_balancing_strategy":"primary","db_duration_s":0.004164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.276655] gitaly[902]: time="2026-08-16T17:06:51.955Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:21.754" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.954" grpc.time_ms=0.467 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.277524] nixbot[2674]: INFO: ::ffff:127.0.0.1:43872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab # [ 258.277923] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.842Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"48cc040b2aeb8d57278b4d14","created_at":"2026-08-16T17:06:49.735Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.738Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-48cc040b2aeb8d57278b4d14: start","job_status":"start","queue_duration_s":2.104272,"scheduling_latency_s":2.104292} gitlab # [ 258.278466] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.892Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"48cc040b2aeb8d57278b4d14","created_at":"2026-08-16T17:06:49.735Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.738Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-48cc040b2aeb8d57278b4d14: done: 0.049512 sec","job_status":"done","queue_duration_s":2.104272,"scheduling_latency_s":2.104292,"redis_calls":14,"redis_duration_s":0.0026,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000598679,"duration_s":0.049512,"completed_at":"2026-08-16T17:06:51.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011317,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.308678] gitaly[902]: time="2026-08-16T17:06:51.961Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:07:01.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:51.956" grpc.time_ms=4.448 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.349811] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.893Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"755dafffcb1ba4a205e3a183","created_at":"2026-08-16T17:06:49.803Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.816Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-755dafffcb1ba4a205e3a183: start","job_status":"start","queue_duration_s":2.076353,"scheduling_latency_s":2.076367} gitlab # [ 258.350621] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"755dafffcb1ba4a205e3a183","created_at":"2026-08-16T17:06:49.803Z","trace_propagation_headers":{"sentry-trace":"480149b327264a31be5c7aa06fc66bdb-18cfe8a62c7044ff","baggage":"sentry-trace_id=480149b327264a31be5c7aa06fc66bdb,sentry-release=Unknown"},"correlation_id":"01M05RK3R5ENQVXPRBS73Y3SKQ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.816Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-755dafffcb1ba4a205e3a183: done: 0.01639 sec","job_status":"done","queue_duration_s":2.076353,"scheduling_latency_s":2.076367,"redis_calls":8,"redis_duration_s":0.00102,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01639,"completed_at":"2026-08-16T17:06:51.909Z","load_balancing_strategy":"primary","db_duration_s":0.002334,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 258.387607] gitaly[902]: time="2026-08-16T17:06:51.989Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:21.788" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.989" grpc.time_ms=0.489 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.388394] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.910Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"10722e5585e28fb80e342a59","created_at":"2026-08-16T17:06:49.960Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ba6c27110cd7d9ec53e7cc86","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.963Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-10722e5585e28fb80e342a59: start","job_status":"start","queue_duration_s":1.947537,"scheduling_latency_s":1.947551} gitlab # [ 258.389093] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.940Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"10722e5585e28fb80e342a59","created_at":"2026-08-16T17:06:49.960Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"ba6c27110cd7d9ec53e7cc86","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:49.963Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-10722e5585e28fb80e342a59: done: 0.02938 sec","job_status":"done","queue_duration_s":1.947537,"scheduling_latency_s":1.947551,"gitaly_calls":1,"gitaly_duration_s":0.010744,"redis_calls":12,"redis_duration_s":0.0017499999999999998,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000334,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.018911343,"duration_s":0.02938,"completed_at":"2026-08-16T17:06:51.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002568,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.425764] gitaly[902]: time="2026-08-16T17:06:51.993Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=55 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:07:21.791" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:51.992" grpc.time_ms=1.581 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.466051] nixbot[2674]: {"ts": "2026-08-16T17:06:52.181Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 258.466601] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:51.941Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"46129efd1432c2f3dde178dd","created_at":"2026-08-16T17:06:50.094Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9c3f4d9a3b7f63d9d8fb58ac3a0fcda61f3f563c103fb4f221b19a9a2591aac8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.096Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-46129efd1432c2f3dde178dd: start","job_status":"start","queue_duration_s":1.844832,"scheduling_latency_s":1.844845} gitlab # [ 258.467184] gitaly[902]: time="2026-08-16T17:06:52.013Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.008" grpc.time_ms=4.541 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.467751] gitaly[902]: time="2026-08-16T17:06:52.236Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.236" grpc.time_ms=0.722 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.555366] gitaly[902]: time="2026-08-16T17:06:52.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:07:22.123" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.323" grpc.time_ms=8.208 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.575899] gitaly[902]: time="2026-08-16T17:06:52.352Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RK3N0FWAPYMA73MHP365W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:07:22.144" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.344" grpc.time_ms=7.628 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.581714] gitaly[902]: time="2026-08-16T17:06:52.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.351" grpc.time_ms=6.738 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.587708] sidekiq-cluster[2616]: {"severity":"WARN","time":"2026-08-16T17:06:52.364Z","class":"CreatePipelineWorker","correlation_id":"01M05RK3N0FWAPYMA73MHP365W","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926","after":"e652aafceb871cb9d38ca62ebe5294ea158d1c90","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e652aafceb871cb9d38ca62ebe5294ea158d1c90","ref":"refs/heads/master"},"retry":0} gitlab # [ 258.591533] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.368Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"46129efd1432c2f3dde178dd","created_at":"2026-08-16T17:06:50.094Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9c3f4d9a3b7f63d9d8fb58ac3a0fcda61f3f563c103fb4f221b19a9a2591aac8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.096Z","job_size_bytes":467,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-46129efd1432c2f3dde178dd: done: 0.42656 sec","job_status":"done","queue_duration_s":1.844832,"scheduling_latency_s":1.844845,"gitaly_calls":7,"gitaly_duration_s":0.048529,"redis_calls":33,"redis_duration_s":0.003387,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000366,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001643,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.354345,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.42656,"completed_at":"2026-08-16T17:06:52.368Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01376,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 258.605608] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.369Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e089d911-cb01-4cd6-abe9-16d03822b108\"}"],"class":"WebHookWorker","jid":"1dc0751776295abdfffb401a","created_at":"2026-08-16T17:06:50.115Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9eb0890d8c8aaa63e67c20915ed65302c4d37e4b253a5eb81957a129a8b3dd04","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.117Z","job_size_bytes":1749,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1dc0751776295abdfffb401a: start","job_status":"start","queue_duration_s":2.251626,"scheduling_latency_s":2.251644} gitlab # [ 258.643043] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.399Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e089d911-cb01-4cd6-abe9-16d03822b108\"}"],"class":"WebHookWorker","jid":"1dc0751776295abdfffb401a","created_at":"2026-08-16T17:06:50.115Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-33ef601405c847cd","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9eb0890d8c8aaa63e67c20915ed65302c4d37e4b253a5eb81957a129a8b3dd04","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.117Z","job_size_bytes":1749,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-1dc0751776295abdfffb401a: done: 0.029964 sec","job_status":"done","queue_duration_s":2.251626,"scheduling_latency_s":2.251644,"redis_calls":14,"redis_duration_s":0.003023,"redis_read_bytes":25,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000287,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.004857321999963915,"cpu_s":0.017243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.029964,"completed_at":"2026-08-16T17:06:52.399Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.685541] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"210a1f48ac10e4c77083a7b0","created_at":"2026-08-16T17:06:50.277Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-e7ffa8db8f354744","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.283Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-210a1f48ac10e4c77083a7b0: start","job_status":"start","queue_duration_s":2.117248,"scheduling_latency_s":2.117268} gitlab # [ 258.686216] nixbot[2674]: INFO: ::ffff:127.0.0.1:43876 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 258.686621] nixbot[2674]: {"ts": "2026-08-16T17:06:52.424Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab # [ 258.690551] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 234 gitlab # [ 258.693126] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"210a1f48ac10e4c77083a7b0","created_at":"2026-08-16T17:06:50.277Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-e7ffa8db8f354744","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:50.283Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-210a1f48ac10e4c77083a7b0: done: 0.046165 sec","job_status":"done","queue_duration_s":2.117248,"scheduling_latency_s":2.117268,"redis_calls":19,"redis_duration_s":0.0070550000000000005,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001809,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00038,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.004375,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.005590375,"duration_s":0.046165,"completed_at":"2026-08-16T17:06:52.446Z","load_balancing_strategy":"primary","db_duration_s":0.011825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.746962] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.448Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dc614e3d8dea584cecbf3ece"],"class":"WebHooks::LogExecutionWorker","jid":"91e429a8fbda58f748bbe86a","created_at":"2026-08-16T17:06:51.240Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-fee729381711424a","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27cae85cd8d60e8ad4968007f2bb60cd457c6b8bde309197d255d5d89c7030a7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:51.249Z","job_size_bytes":2593,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-91e429a8fbda58f748bbe86a: start","job_status":"start","queue_duration_s":1.199684,"scheduling_latency_s":1.199698} gitlab # [ 258.747686] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.501Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dc614e3d8dea584cecbf3ece"],"class":"WebHooks::LogExecutionWorker","jid":"91e429a8fbda58f748bbe86a","created_at":"2026-08-16T17:06:51.240Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-fee729381711424a","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27cae85cd8d60e8ad4968007f2bb60cd457c6b8bde309197d255d5d89c7030a7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:51.249Z","job_size_bytes":2593,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-91e429a8fbda58f748bbe86a: done: 0.05219 sec","job_status":"done","queue_duration_s":1.199684,"scheduling_latency_s":1.199698,"redis_calls":10,"redis_duration_s":0.007521,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003782,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001494,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002245,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000477156,"duration_s":0.05219,"completed_at":"2026-08-16T17:06:52.501Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.764379] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.502Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1dc0751776295abdfffb401a"],"class":"WebHooks::LogExecutionWorker","jid":"7383ff9b2e12bc6e54e41ee8","created_at":"2026-08-16T17:06:52.391Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-9d6214d7e36e4d43","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e972e96c7f06d3355a08fec34870d258437bb0a34d212057d354ec993bad979e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.394Z","job_size_bytes":2592,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7383ff9b2e12bc6e54e41ee8: start","job_status":"start","queue_duration_s":0.108503,"scheduling_latency_s":0.108518} gitlab # [ 258.778159] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 96 gitlab # [ 258.778809] gitaly[902]: time="2026-08-16T17:06:52.491Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQCCMFBP6DQWD7CA065G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.489" grpc.time_ms=2.129 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.822614] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.522Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","1dc0751776295abdfffb401a"],"class":"WebHooks::LogExecutionWorker","jid":"7383ff9b2e12bc6e54e41ee8","created_at":"2026-08-16T17:06:52.391Z","trace_propagation_headers":{"sentry-trace":"531502debddd4f2094078f122281cd21-9d6214d7e36e4d43","baggage":"sentry-trace_id=531502debddd4f2094078f122281cd21,sentry-release=Unknown"},"correlation_id":"01M05RK3N0FWAPYMA73MHP365W","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e972e96c7f06d3355a08fec34870d258437bb0a34d212057d354ec993bad979e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.394Z","job_size_bytes":2592,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-7383ff9b2e12bc6e54e41ee8: done: 0.020313 sec","job_status":"done","queue_duration_s":0.108503,"scheduling_latency_s":0.108518,"redis_calls":7,"redis_duration_s":0.002718,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020313,"completed_at":"2026-08-16T17:06:52.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.823802] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.529Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f866f418d14849a66ab489c5","created_at":"2026-08-16T17:06:52.405Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-90d5d62c0fcb4dd8","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.410Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f866f418d14849a66ab489c5: start","job_status":"start","queue_duration_s":0.118659,"scheduling_latency_s":0.118675} gitlab # [ 258.836582] nixbot[2674]: {"ts": "2026-08-16T17:06:52.587Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab # [ 258.838996] gitlab-workhorse[824]: time="2026-08-16T17:06:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 258.840382] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 75 gitlab # [ 258.841819] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 157 gitlab # [ 258.844410] gitaly[902]: time="2026-08-16T17:06:52.508Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQBW350DDNV8FEPHPZ4W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.497" grpc.time_ms=10.296 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.855325] gitaly[902]: time="2026-08-16T17:06:52.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQCCMFBP6DQWD7CA065G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.524" grpc.time_ms=4.937 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.892458] gitaly[902]: time="2026-08-16T17:06:52.584Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQEXZVPAGKNNZ3PBNFWR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.575" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 258.909998] nix-daemon[2877]: accepted connection from pid 3373, user nixbot gitlab # [ 258.910751] gitaly[902]: time="2026-08-16T17:06:52.584Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQEXZVPAGKNNZ3PBNFWR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.575" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.911458] gitaly[902]: time="2026-08-16T17:06:52.584Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQEXZVPAGKNNZ3PBNFWR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.575" grpc.time_ms=9.309 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.911989] gitaly[902]: time="2026-08-16T17:06:52.684Z" level=info msg="finished unary call with code OK" catfile.duration_ms=29 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=29 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQHFH4THDXJV2VXKPMHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.354" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.654" grpc.time_ms=29.877 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.912757] gitaly[902]: time="2026-08-16T17:06:52.689Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:52.687" grpc.time_ms=0.536 pid=902 span.kind=server system=grpc gitlab # [ 258.944165] gitaly[902]: time="2026-08-16T17:06:52.721Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:52.720" grpc.time_ms=0.212 pid=902 span.kind=server system=grpc gitlab # [ 258.949140] gitaly[902]: time="2026-08-16T17:06:52.726Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQHFH4THDXJV2VXKPMHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:02.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.717" grpc.time_ms=8.76 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.958039] gitaly[902]: time="2026-08-16T17:06:52.734Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=10 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQJQ5RRCH2TDCHBTHAKF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.716" grpc.time_ms=18.078 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 258.961136] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 103 gitlab # [ 258.984096] gitaly[902]: time="2026-08-16T17:06:52.760Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:52.760" grpc.time_ms=0.305 pid=902 span.kind=server system=grpc gitlab # [ 258.991555] gitaly[902]: time="2026-08-16T17:06:52.768Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX diskcache=39aa8b26-2a75-4a51-9ed6-d446823fdeaa grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:22.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.610" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 258.994113] gitaly[902]: time="2026-08-16T17:06:52.769Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7233 command.oublock=0 command.real_time_ms=153 command.spawn_token_fork_ms=1 command.system_time_ms=45 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:22.409" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:52.610" grpc.time_ms=159.054 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.002812] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 188 gitlab # [ 259.003789] nixbot[2674]: {"ts": "2026-08-16T17:06:52.780Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/0a07b83bc5d4ea2b1256c98a01a70f9b1d3f2926 \"HTTP/1.1 201 Created\""} gitlab # [ 259.027345] gitaly[902]: time="2026-08-16T17:06:52.804Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQP0WJFJ7SQ5S031196S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.797" pid=902 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 259.027871] gitaly[902]: time="2026-08-16T17:06:52.804Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQP0WJFJ7SQ5S031196S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.797" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.028942] gitaly[902]: time="2026-08-16T17:06:52.805Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQP0WJFJ7SQ5S031196S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.797" grpc.time_ms=8.483 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.031122] gitlab-workhorse[824]: time="2026-08-16T17:06:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 259.031797] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 69 gitlab # [ 259.083159] gitaly[902]: time="2026-08-16T17:06:52.859Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:22.658" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.858" grpc.time_ms=0.902 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.094867] gitaly[902]: time="2026-08-16T17:06:52.871Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQRY03VPTK0W1TYDR5XD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:52.865" grpc.time_ms=6.236 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 259.096094] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 42 gitlab # [ 259.103571] gitaly[902]: time="2026-08-16T17:06:52.880Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:22.679" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:52.879" grpc.time_ms=0.449 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.112501] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.889Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"55701015ea7faa393848908d","created_at":"2026-08-16T17:06:52.887Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"f866f418d14849a66ab489c5","job_size_bytes":3,"pid":2616,"job_status":"deduplicated","message":"PipelineProcessWorker JID-55701015ea7faa393848908d: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 259.113535] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.890Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f866f418d14849a66ab489c5","created_at":"2026-08-16T17:06:52.405Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-90d5d62c0fcb4dd8","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.410Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2616,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f866f418d14849a66ab489c5: rescheduled"} gitlab # [ 259.118465] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.895Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f866f418d14849a66ab489c5","created_at":"2026-08-16T17:06:52.405Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-90d5d62c0fcb4dd8","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.410Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f866f418d14849a66ab489c5: done: 0.365731 sec","job_status":"done","queue_duration_s":0.118659,"scheduling_latency_s":0.118675,"gitaly_calls":3,"gitaly_duration_s":0.168413,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.053657,"redis_read_bytes":227,"redis_write_bytes":18467,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001875,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000625,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.037239,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.008628,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000152,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00096,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002303,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.016,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.016,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.02,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091753,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.327490505,"duration_s":0.365731,"completed_at":"2026-08-16T17:06:52.894Z","load_balancing_strategy":"primary","db_duration_s":0.050428,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.157815] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6aa8c2fe41cb75b86089e897","created_at":"2026-08-16T17:06:52.435Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-747cc18611184935","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.439Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6aa8c2fe41cb75b86089e897: start","job_status":"start","queue_duration_s":0.45678,"scheduling_latency_s":0.456804} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 259.176477] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.953Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"6aa8c2fe41cb75b86089e897","created_at":"2026-08-16T17:06:52.435Z","trace_propagation_headers":{"sentry-trace":"acd9f19bd0ea4ff0af442accfc308c74-747cc18611184935","baggage":"sentry-trace_id=acd9f19bd0ea4ff0af442accfc308c74,sentry-release=Unknown"},"correlation_id":"01M05RJZCD21JKPFK9SA7DGA9C","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.439Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-6aa8c2fe41cb75b86089e897: done: 0.056881 sec","job_status":"done","queue_duration_s":0.45678,"scheduling_latency_s":0.456804,"redis_calls":11,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.056881,"completed_at":"2026-08-16T17:06:52.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012664,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.225913] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.954Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"360a0f0a81d63d46faa27fb6","created_at":"2026-08-16T17:06:52.597Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.603Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-360a0f0a81d63d46faa27fb6: start","job_status":"start","queue_duration_s":0.350714,"scheduling_latency_s":0.350729} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.05 seconds) gitlab # [ 259.226591] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.979Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"360a0f0a81d63d46faa27fb6","created_at":"2026-08-16T17:06:52.597Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.603Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-360a0f0a81d63d46faa27fb6: done: 0.025292 sec","job_status":"done","queue_duration_s":0.350714,"scheduling_latency_s":0.350729,"redis_calls":7,"redis_duration_s":0.000946,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000241,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025292,"completed_at":"2026-08-16T17:06:52.979Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.274335] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.980Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5f01213fa5e0ae994655ece7","created_at":"2026-08-16T17:06:52.775Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.777Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5f01213fa5e0ae994655ece7: start","job_status":"start","queue_duration_s":0.202607,"scheduling_latency_s":0.202624} gitlab # [ 259.274969] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.996Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5f01213fa5e0ae994655ece7","created_at":"2026-08-16T17:06:52.775Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.777Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5f01213fa5e0ae994655ece7: done: 0.015866 sec","job_status":"done","queue_duration_s":0.202607,"scheduling_latency_s":0.202624,"redis_calls":7,"redis_duration_s":0.000927,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015866,"completed_at":"2026-08-16T17:06:52.996Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.292447] nixbot[2674]: INFO: ::ffff:127.0.0.1:43892 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab # [ 259.293714] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:52.997Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"28db01467dac315ef30e8307","created_at":"2026-08-16T17:06:52.788Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.791Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-28db01467dac315ef30e8307: start","job_status":"start","queue_duration_s":0.206022,"scheduling_latency_s":0.206037} gitlab # [ 259.336923] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"28db01467dac315ef30e8307","created_at":"2026-08-16T17:06:52.788Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.791Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-28db01467dac315ef30e8307: done: 0.018266 sec","job_status":"done","queue_duration_s":0.206022,"scheduling_latency_s":0.206037,"redis_calls":7,"redis_duration_s":0.001738,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001426,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018266,"completed_at":"2026-08-16T17:06:53.015Z","load_balancing_strategy":"primary","db_duration_s":0.003701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.341366] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.016Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4c902801cd6fee60d7f7f733","created_at":"2026-08-16T17:06:52.800Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.804Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4c902801cd6fee60d7f7f733: start","job_status":"start","queue_duration_s":0.211802,"scheduling_latency_s":0.211817} gitlab # [ 259.375719] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.038Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"4c902801cd6fee60d7f7f733","created_at":"2026-08-16T17:06:52.800Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.804Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-4c902801cd6fee60d7f7f733: done: 0.02207 sec","job_status":"done","queue_duration_s":0.211802,"scheduling_latency_s":0.211817,"redis_calls":10,"redis_duration_s":0.002285,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000403,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02207,"completed_at":"2026-08-16T17:06:53.038Z","load_balancing_strategy":"primary","db_duration_s":0.003644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.411166] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.039Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"df0084360c9b2b2f68b121e9","created_at":"2026-08-16T17:06:52.840Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.842Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-df0084360c9b2b2f68b121e9: start","job_status":"start","queue_duration_s":0.197096,"scheduling_latency_s":0.197111} gitlab # [ 259.411837] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.054Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"df0084360c9b2b2f68b121e9","created_at":"2026-08-16T17:06:52.840Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.842Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-df0084360c9b2b2f68b121e9: done: 0.01549 sec","job_status":"done","queue_duration_s":0.197096,"scheduling_latency_s":0.197111,"redis_calls":7,"redis_duration_s":0.000954,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01549,"completed_at":"2026-08-16T17:06:53.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002655,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.456804] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.055Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3ad9663ecadc70fc8072fcb2","created_at":"2026-08-16T17:06:52.842Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.844Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3ad9663ecadc70fc8072fcb2: start","job_status":"start","queue_duration_s":0.211558,"scheduling_latency_s":0.211572} gitlab # [ 259.457490] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.070Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3ad9663ecadc70fc8072fcb2","created_at":"2026-08-16T17:06:52.842Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.844Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3ad9663ecadc70fc8072fcb2: done: 0.01463 sec","job_status":"done","queue_duration_s":0.211558,"scheduling_latency_s":0.211572,"redis_calls":8,"redis_duration_s":0.001077,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01463,"completed_at":"2026-08-16T17:06:53.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.494123] gitaly[902]: time="2026-08-16T17:06:53.190Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:53.189" grpc.time_ms=1.117 pid=902 span.kind=server system=grpc gitlab # [ 259.494715] gitaly[902]: time="2026-08-16T17:06:53.210Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:53.209" grpc.time_ms=1.094 pid=902 span.kind=server system=grpc gitlab # [ 259.500879] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.071Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"77e3d41e3a356caf2c410485","created_at":"2026-08-16T17:06:52.844Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.846Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-77e3d41e3a356caf2c410485: start","job_status":"start","queue_duration_s":0.225141,"scheduling_latency_s":0.225155} gitlab # [ 259.514536] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.084Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"77e3d41e3a356caf2c410485","created_at":"2026-08-16T17:06:52.844Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.846Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-77e3d41e3a356caf2c410485: done: 0.013356 sec","job_status":"done","queue_duration_s":0.225141,"scheduling_latency_s":0.225155,"redis_calls":7,"redis_duration_s":0.000941,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013356,"completed_at":"2026-08-16T17:06:53.084Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.556166] gitaly[902]: time="2026-08-16T17:06:53.229Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:53.228" grpc.time_ms=0.331 pid=902 span.kind=server system=grpc gitlab # [ 259.556689] gitaly[902]: time="2026-08-16T17:06:53.240Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX diskcache=c1ebb3dc-5db0-44d5-9fae-c72e639cf427 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:23.167" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.167" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.564420] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.085Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7ea5cc2559cee790ebd6aa44","created_at":"2026-08-16T17:06:52.846Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.847Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7ea5cc2559cee790ebd6aa44: start","job_status":"start","queue_duration_s":0.237978,"scheduling_latency_s":0.237993} gitlab # [ 259.604238] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.101Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"7ea5cc2559cee790ebd6aa44","created_at":"2026-08-16T17:06:52.846Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.847Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-7ea5cc2559cee790ebd6aa44: done: 0.015894 sec","job_status":"done","queue_duration_s":0.237978,"scheduling_latency_s":0.237993,"redis_calls":7,"redis_duration_s":0.000911,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015894,"completed_at":"2026-08-16T17:06:53.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003376,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.644129] gitaly[902]: time="2026-08-16T17:06:53.240Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7546 command.oublock=0 command.real_time_ms=63 command.spawn_token_fork_ms=0 command.system_time_ms=43 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:23.167" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.167" grpc.time_ms=72.675 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.644758] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"41237a79b698aea146f1de71","created_at":"2026-08-16T17:06:52.847Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.848Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-41237a79b698aea146f1de71: start","job_status":"start","queue_duration_s":0.253554,"scheduling_latency_s":0.253569} gitlab # [ 259.645435] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"41237a79b698aea146f1de71","created_at":"2026-08-16T17:06:52.847Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.848Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-41237a79b698aea146f1de71: done: 0.008701 sec","job_status":"done","queue_duration_s":0.253554,"scheduling_latency_s":0.253569,"redis_calls":7,"redis_duration_s":0.000991,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008701,"completed_at":"2026-08-16T17:06:53.111Z","load_balancing_strategy":"primary","db_duration_s":0.000246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.684205] gitaly[902]: time="2026-08-16T17:06:53.278Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:23.076" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.277" grpc.time_ms=0.669 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.684552] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dcb7990c8b2664811d8d0846","created_at":"2026-08-16T17:06:52.849Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.850Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dcb7990c8b2664811d8d0846: start","job_status":"start","queue_duration_s":0.261875,"scheduling_latency_s":0.261889} gitlab # [ 259.719662] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.125Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"dcb7990c8b2664811d8d0846","created_at":"2026-08-16T17:06:52.849Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.850Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-dcb7990c8b2664811d8d0846: done: 0.013548 sec","job_status":"done","queue_duration_s":0.261875,"scheduling_latency_s":0.261889,"redis_calls":7,"redis_duration_s":0.000959,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013548,"completed_at":"2026-08-16T17:06:53.125Z","load_balancing_strategy":"primary","db_duration_s":0.00194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.723249] gitaly[902]: time="2026-08-16T17:06:53.300Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQ4XXTA6R6YTY7ZRZBAX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:23.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.299" grpc.time_ms=0.552 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 259.733387] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.126Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2789d2adc3753281c3569fb1","created_at":"2026-08-16T17:06:52.890Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.891Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2789d2adc3753281c3569fb1: start","job_status":"start","queue_duration_s":0.234879,"scheduling_latency_s":0.234894} gitlab # [ 259.768907] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.308Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"2789d2adc3753281c3569fb1","created_at":"2026-08-16T17:06:52.890Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-7411762450cc4d43","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:52.891Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2789d2adc3753281c3569fb1: done: 0.182002 sec","job_status":"done","queue_duration_s":0.234879,"scheduling_latency_s":0.234894,"gitaly_calls":3,"gitaly_duration_s":0.079615,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007384,"redis_read_bytes":141,"redis_write_bytes":16720,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000325,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000675,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001729,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002691,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000166,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000414,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080126,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16235164,"duration_s":0.182002,"completed_at":"2026-08-16T17:06:53.308Z","load_balancing_strategy":"primary","db_duration_s":0.019718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.787253] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5e55ed19ae1619e6d4491440","created_at":"2026-08-16T17:06:53.162Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.163Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5e55ed19ae1619e6d4491440: start","job_status":"start","queue_duration_s":0.145585,"scheduling_latency_s":0.145599} gitlab # [ 259.800560] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.334Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5e55ed19ae1619e6d4491440","created_at":"2026-08-16T17:06:53.162Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.163Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5e55ed19ae1619e6d4491440: done: 0.02518 sec","job_status":"done","queue_duration_s":0.145585,"scheduling_latency_s":0.145599,"redis_calls":7,"redis_duration_s":0.001112,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01832,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02518,"completed_at":"2026-08-16T17:06:53.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004276,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 259.840988] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cb70126591d639ef08608457","created_at":"2026-08-16T17:06:53.245Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.247Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cb70126591d639ef08608457: start","job_status":"start","queue_duration_s":0.088471,"scheduling_latency_s":0.088486} gitlab # [ 259.878443] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.351Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"cb70126591d639ef08608457","created_at":"2026-08-16T17:06:53.245Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.247Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-cb70126591d639ef08608457: done: 0.015842 sec","job_status":"done","queue_duration_s":0.088471,"scheduling_latency_s":0.088486,"redis_calls":7,"redis_duration_s":0.0009249999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015842,"completed_at":"2026-08-16T17:06:53.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.881055] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2b7804668ebd7ee5fdfba8f6","created_at":"2026-08-16T17:06:53.251Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.255Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2b7804668ebd7ee5fdfba8f6: start","job_status":"start","queue_duration_s":0.09729,"scheduling_latency_s":0.097304} gitlab # [ 259.894021] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.369Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"2b7804668ebd7ee5fdfba8f6","created_at":"2026-08-16T17:06:53.251Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.255Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-2b7804668ebd7ee5fdfba8f6: done: 0.017525 sec","job_status":"done","queue_duration_s":0.09729,"scheduling_latency_s":0.097304,"redis_calls":7,"redis_duration_s":0.001135,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017525,"completed_at":"2026-08-16T17:06:53.369Z","load_balancing_strategy":"primary","db_duration_s":0.003436,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.934285] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.370Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"26b0e264fdc3445ba57f8236","created_at":"2026-08-16T17:06:53.261Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.262Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-26b0e264fdc3445ba57f8236: start","job_status":"start","queue_duration_s":0.108395,"scheduling_latency_s":0.10841} gitlab # [ 259.972821] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.389Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"26b0e264fdc3445ba57f8236","created_at":"2026-08-16T17:06:53.261Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.262Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-26b0e264fdc3445ba57f8236: done: 0.0186 sec","job_status":"done","queue_duration_s":0.108395,"scheduling_latency_s":0.10841,"redis_calls":10,"redis_duration_s":0.001363,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000387,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0186,"completed_at":"2026-08-16T17:06:53.389Z","load_balancing_strategy":"primary","db_duration_s":0.002915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.974474] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.390Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8e54ebfb51f60a537da22e97","created_at":"2026-08-16T17:06:53.262Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.263Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8e54ebfb51f60a537da22e97: start","job_status":"start","queue_duration_s":0.126669,"scheduling_latency_s":0.126685} gitlab # [ 260.017974] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.405Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"8e54ebfb51f60a537da22e97","created_at":"2026-08-16T17:06:53.262Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.263Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-8e54ebfb51f60a537da22e97: done: 0.015492 sec","job_status":"done","queue_duration_s":0.126669,"scheduling_latency_s":0.126685,"redis_calls":7,"redis_duration_s":0.00101,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015492,"completed_at":"2026-08-16T17:06:53.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.022289] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.406Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ad9e18ad7a275739c31941c","created_at":"2026-08-16T17:06:53.263Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.265Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ad9e18ad7a275739c31941c: start","job_status":"start","queue_duration_s":0.141486,"scheduling_latency_s":0.141502} gitlab # [ 260.065227] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.421Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ad9e18ad7a275739c31941c","created_at":"2026-08-16T17:06:53.263Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.265Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ad9e18ad7a275739c31941c: done: 0.014857 sec","job_status":"done","queue_duration_s":0.141486,"scheduling_latency_s":0.141502,"redis_calls":8,"redis_duration_s":0.001107,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014857,"completed_at":"2026-08-16T17:06:53.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.070069] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.422Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"80d9ec762995386fc4a57a97","created_at":"2026-08-16T17:06:53.265Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.266Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-80d9ec762995386fc4a57a97: start","job_status":"start","queue_duration_s":0.155684,"scheduling_latency_s":0.155699} gitlab # [ 260.105911] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.435Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"80d9ec762995386fc4a57a97","created_at":"2026-08-16T17:06:53.265Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.266Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-80d9ec762995386fc4a57a97: done: 0.013061 sec","job_status":"done","queue_duration_s":0.155684,"scheduling_latency_s":0.155699,"redis_calls":7,"redis_duration_s":0.000875,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013061,"completed_at":"2026-08-16T17:06:53.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.119179] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.436Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"18efa2c675dafe0b0c8cf2dc","created_at":"2026-08-16T17:06:53.267Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.268Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-18efa2c675dafe0b0c8cf2dc: start","job_status":"start","queue_duration_s":0.168431,"scheduling_latency_s":0.168444} gitlab # [ 260.133307] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.451Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"18efa2c675dafe0b0c8cf2dc","created_at":"2026-08-16T17:06:53.267Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.268Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-18efa2c675dafe0b0c8cf2dc: done: 0.015526 sec","job_status":"done","queue_duration_s":0.168431,"scheduling_latency_s":0.168444,"redis_calls":7,"redis_duration_s":0.0009530000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015526,"completed_at":"2026-08-16T17:06:53.451Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.186158] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"09b9eb699d59734a141205d7","created_at":"2026-08-16T17:06:53.268Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.269Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-09b9eb699d59734a141205d7: start","job_status":"start","queue_duration_s":0.183674,"scheduling_latency_s":0.183686} gitlab # [ 260.186787] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.461Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"09b9eb699d59734a141205d7","created_at":"2026-08-16T17:06:53.268Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.269Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-09b9eb699d59734a141205d7: done: 0.008349 sec","job_status":"done","queue_duration_s":0.183674,"scheduling_latency_s":0.183686,"redis_calls":7,"redis_duration_s":0.0008680000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008349,"completed_at":"2026-08-16T17:06:53.461Z","load_balancing_strategy":"primary","db_duration_s":0.000271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 260.223023] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.462Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a677dac5d3d44a3076d0329b","created_at":"2026-08-16T17:06:53.269Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.270Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a677dac5d3d44a3076d0329b: start","job_status":"start","queue_duration_s":0.191734,"scheduling_latency_s":0.191746} gitlab # [ 260.225544] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:53.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a677dac5d3d44a3076d0329b","created_at":"2026-08-16T17:06:53.269Z","trace_propagation_headers":{"sentry-trace":"50ddc4f17dcc4d12881aafb2b24ca03f-92043ab538f54fed","baggage":"sentry-trace_id=50ddc4f17dcc4d12881aafb2b24ca03f,sentry-release=Unknown"},"correlation_id":"01M05RMQ4XXTA6R6YTY7ZRZBAX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:53.270Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a677dac5d3d44a3076d0329b: done: 0.013132 sec","job_status":"done","queue_duration_s":0.191734,"scheduling_latency_s":0.191746,"redis_calls":7,"redis_duration_s":0.000882,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000236,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013132,"completed_at":"2026-08-16T17:06:53.475Z","load_balancing_strategy":"primary","db_duration_s":0.001845,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) gitlab # [ 260.290839] nixbot[2674]: INFO: ::ffff:127.0.0.1:43900 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab # [ 260.352125] gitaly[902]: time="2026-08-16T17:06:54.128Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQTAQQNPN6GCCM62WYYE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.109" pid=902 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 260.353173] gitaly[902]: time="2026-08-16T17:06:54.128Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQTAQQNPN6GCCM62WYYE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.109" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.353707] gitaly[902]: time="2026-08-16T17:06:54.128Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMQTAQQNPN6GCCM62WYYE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.109" grpc.time_ms=19.447 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 260.383616] gitlab-workhorse[824]: time="2026-08-16T17:06:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 260.384258] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1285 gitlab # [ 260.476656] gitaly[902]: time="2026-08-16T17:06:54.253Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.051" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.252" grpc.time_ms=0.932 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.510156] gitaly[902]: time="2026-08-16T17:06:54.286Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=647 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:07:24.078" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.279" grpc.time_ms=7.451 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.550737] gitaly[902]: time="2026-08-16T17:06:54.327Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:04.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.318" grpc.time_ms=9.126 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.568766] gitaly[902]: time="2026-08-16T17:06:54.345Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:07:04.004" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.345" grpc.time_ms=0.368 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.581955] gitaly[902]: time="2026-08-16T17:06:54.358Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:07:04.007" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.348" grpc.time_ms=10.357 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.639028] gitaly[902]: time="2026-08-16T17:06:54.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:54.415" grpc.time_ms=0.563 pid=902 span.kind=server system=grpc gitlab # [ 260.678863] gitaly[902]: time="2026-08-16T17:06:54.455Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:54.454" grpc.time_ms=0.678 pid=902 span.kind=server system=grpc gitlab # [ 260.691778] gitaly[902]: time="2026-08-16T17:06:54.468Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" operations="[repack_refs]" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root gitlab # [ 260.694701] gitaly[902]: time="2026-08-16T17:06:54.471Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 17:05:53.070428901 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root gitlab # [ 260.718281] gitaly[902]: time="2026-08-16T17:06:54.495Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J diskcache=4db4c80a-1470-4f25-9d3d-68d7fb562bf3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root gitlab # [ 260.719493] gitaly[902]: time="2026-08-16T17:06:54.495Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=94 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6399 command.oublock=8 command.real_time_ms=107 command.spawn_token_fork_ms=0 command.system_time_ms=61 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" grpc.time_ms=123.731 pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root gitlab # [ 260.720537] gitaly[902]: time="2026-08-16T17:06:54.496Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 260.721499] gitaly[902]: time="2026-08-16T17:06:54.496Z" level=info msg="optimized repository" clean_stale_data_time=23.738771ms clean_work_trees_time="79.619µs" commit_graph_time="3.911µs" correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=902 prune_time="3.352µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=23.955279ms gitlab # [ 260.722212] gitaly[902]: time="2026-08-16T17:06:54.496Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:07:04.030" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:54.371" pid=902 ref=refs/keep-around/e652aafceb871cb9d38ca62ebe5294ea158d1c90 remote_ip="2001:db8:1::1" revision=e652aafceb871cb9d38ca62ebe5294ea158d1c90 span.kind=server system=grpc username=root gitlab # [ 260.730647] gitaly[902]: time="2026-08-16T17:06:54.500Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.199" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.499" grpc.time_ms=0.408 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.741567] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.509Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bc848584deff658fb0b80865","created_at":"2026-08-16T17:06:54.501Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.505Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bc848584deff658fb0b80865: start","job_status":"start","queue_duration_s":0.003991,"scheduling_latency_s":0.004037} gitlab # [ 260.762584] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.539Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bc848584deff658fb0b80865","created_at":"2026-08-16T17:06:54.501Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.505Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bc848584deff658fb0b80865: done: 0.030208 sec","job_status":"done","queue_duration_s":0.003991,"scheduling_latency_s":0.004037,"redis_calls":7,"redis_duration_s":0.005101,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030208,"completed_at":"2026-08-16T17:06:54.539Z","load_balancing_strategy":"primary","db_duration_s":0.003404,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.803873] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.543Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e3934e2164294e17a6345b59","created_at":"2026-08-16T17:06:54.507Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.511Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e3934e2164294e17a6345b59: start","job_status":"start","queue_duration_s":0.031379,"scheduling_latency_s":0.031395} gitlab # [ 260.804904] nixbot[2674]: {"ts": "2026-08-16T17:06:54.576Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""} gitlab # [ 260.805663] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 382 gitlab # [ 260.807669] nixbot[2674]: {"ts": "2026-08-16T17:06:54.581Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e652aafceb87-4"} gitlab # [ 260.811230] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.587Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e3934e2164294e17a6345b59","created_at":"2026-08-16T17:06:54.507Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.511Z","job_size_bytes":65,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e3934e2164294e17a6345b59: done: 0.044637 sec","job_status":"done","queue_duration_s":0.031379,"scheduling_latency_s":0.031395,"redis_calls":10,"redis_duration_s":0.005721,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044637,"completed_at":"2026-08-16T17:06:54.587Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009286,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.852173] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.589Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5b160c25928e05e46aa0df65","created_at":"2026-08-16T17:06:54.561Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.563Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5b160c25928e05e46aa0df65: start","job_status":"start","queue_duration_s":0.025264,"scheduling_latency_s":0.025308} gitlab # [ 260.863674] gitaly[902]: time="2026-08-16T17:06:54.640Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:24.439" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.639" grpc.time_ms=0.662 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.900805] gitaly[902]: time="2026-08-16T17:06:54.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMS3GYA0T8DMBCPXCZ85J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.464" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.664" grpc.time_ms=0.412 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 260.901554] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.676Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5b160c25928e05e46aa0df65","created_at":"2026-08-16T17:06:54.561Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-b35d2dd09feb43fb","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.563Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5b160c25928e05e46aa0df65: done: 0.087965 sec","job_status":"done","queue_duration_s":0.025264,"scheduling_latency_s":0.025308,"gitaly_calls":2,"gitaly_duration_s":0.005049,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.007317,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000631,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003194,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000192,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000155,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000703,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.004,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058543,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.065254662,"duration_s":0.087965,"completed_at":"2026-08-16T17:06:54.676Z","load_balancing_strategy":"primary","db_duration_s":0.020217,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.918522] nix-daemon[2877]: accepted connection from pid 3493, user nixbot gitlab # [ 260.919141] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.683Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"868e15e3c36cc203915da175","created_at":"2026-08-16T17:06:54.626Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-ad193f0c921a4e8e","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.627Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-868e15e3c36cc203915da175: start","job_status":"start","queue_duration_s":0.055641,"scheduling_latency_s":0.055657} gitlab # [ 260.936716] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:54.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"868e15e3c36cc203915da175","created_at":"2026-08-16T17:06:54.626Z","trace_propagation_headers":{"sentry-trace":"6f9fc1b326d8447d99de72d0f7131e66-ad193f0c921a4e8e","baggage":"sentry-trace_id=6f9fc1b326d8447d99de72d0f7131e66,sentry-release=Unknown"},"correlation_id":"01M05RMS3GYA0T8DMBCPXCZ85J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:54.627Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-868e15e3c36cc203915da175: done: 0.030156 sec","job_status":"done","queue_duration_s":0.055641,"scheduling_latency_s":0.055657,"redis_calls":7,"redis_duration_s":0.006019999999999999,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005539,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030156,"completed_at":"2026-08-16T17:06:54.713Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.973632] nix-daemon[2877]: accepted connection from pid 3501, user nixbot gitlab # [ 261.006131] nixbot[2674]: {"ts": "2026-08-16T17:06:54.782Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e652aafceb87-4", "argv0": "bwrap"} gitlab # [ 261.071029] nix-daemon[2877]: accepted connection from pid 3511, user nixbot gitlab # [ 261.136569] nix-daemon[2877]: accepted connection from pid 3521, user nixbot gitlab # [ 261.154546] nix-daemon[2877]: accepted connection from pid 3511, user nixbot gitlab # [ 261.255081] gitaly[902]: time="2026-08-16T17:06:55.031Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.030" grpc.time_ms=1.024 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90' gitlab # [ 261.292279] gitaly[902]: time="2026-08-16T17:06:55.068Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:05.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.056" grpc.time_ms=12.019 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.325583] nixbot[2674]: INFO: ::ffff:127.0.0.1:43902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e652aafceb871cb9d38ca62ebe5294ea158d1c90', in 0.04 seconds) (finished: subtest: push delivers the webhook, in 55.83 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses gitlab # [ 261.367129] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"377abf87468df57a80c6961a","created_at":"2026-08-16T17:06:55.137Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-5e3c1d3edf914aa2","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.140Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-377abf87468df57a80c6961a: start","job_status":"start","queue_duration_s":0.003144,"scheduling_latency_s":0.003177} gitlab # [ 261.397422] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 209 gitlab # [ 261.398814] nixbot[2674]: {"ts": "2026-08-16T17:06:55.175Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""} gitlab # [ 261.407540] gitaly[902]: time="2026-08-16T17:06:55.183Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMT0N5R42PMBYW46BPAWN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.182" grpc.time_ms=0.778 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.442458] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses HTTP/1.1" 200 659 "" "curl/8.21.0" 93 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses, in 0.11 seconds) gitlab # [ 261.447426] gitaly[902]: time="2026-08-16T17:06:55.224Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:55.222" grpc.time_ms=1.425 pid=902 span.kind=server system=grpc gitlab # [ 261.454126] gitaly[902]: time="2026-08-16T17:06:55.227Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMT2BQES452SZKAA462QV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.225" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.225" grpc.time_ms=1.552 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.485529] gitaly[902]: time="2026-08-16T17:06:55.261Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:55.261" grpc.time_ms=0.221 pid=902 span.kind=server system=grpc gitlab # [ 261.493698] gitaly[902]: time="2026-08-16T17:06:55.270Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMT2BQES452SZKAA462QV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:05.209" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.259" grpc.time_ms=10.76 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.514132] gitaly[902]: time="2026-08-16T17:06:55.291Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:55.290" grpc.time_ms=0.37 pid=902 span.kind=server system=grpc gitlab # [ 261.530314] gitaly[902]: time="2026-08-16T17:06:55.307Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 diskcache=f0a3ee31-b745-4fad-8f93-3b33976c5ffd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:25.198" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.198" pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.536505] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 133 gitlab # [ 261.537606] nixbot[2674]: {"ts": "2026-08-16T17:06:55.314Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""} gitlab # [ 261.543062] gitaly[902]: time="2026-08-16T17:06:55.319Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=100 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7457 command.oublock=0 command.real_time_ms=103 command.spawn_token_fork_ms=0 command.system_time_ms=78 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:07:25.198" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:55.198" grpc.time_ms=108.676 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.585255] gitaly[902]: time="2026-08-16T17:06:55.362Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:25.160" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.361" grpc.time_ms=0.69 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.596569] gitaly[902]: time="2026-08-16T17:06:55.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMT6WSJ3QGC11AQ79SJ1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.272" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.372" grpc.time_ms=0.361 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.605240] gitaly[902]: time="2026-08-16T17:06:55.382Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.181" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.381" grpc.time_ms=0.545 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 261.614253] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.390Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0b093d9affc60ab857310459","created_at":"2026-08-16T17:06:55.389Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"377abf87468df57a80c6961a","job_size_bytes":3,"pid":2616,"job_status":"deduplicated","message":"PipelineProcessWorker JID-0b093d9affc60ab857310459: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 261.615284] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.392Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"377abf87468df57a80c6961a","created_at":"2026-08-16T17:06:55.137Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-5e3c1d3edf914aa2","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.140Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2616,"job_status":"rescheduled","message":"PipelineProcessWorker JID-377abf87468df57a80c6961a: rescheduled"} gitlab # [ 261.620031] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.396Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"377abf87468df57a80c6961a","created_at":"2026-08-16T17:06:55.137Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-5e3c1d3edf914aa2","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.140Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-377abf87468df57a80c6961a: done: 0.253158 sec","job_status":"done","queue_duration_s":0.003144,"scheduling_latency_s":0.003177,"gitaly_calls":3,"gitaly_duration_s":0.127981,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011153,"redis_read_bytes":239,"redis_write_bytes":21784,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000977,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00097,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.00228,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14469,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.003718,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000161,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000658,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001412,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095597,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.221837133,"duration_s":0.253158,"completed_at":"2026-08-16T17:06:55.396Z","load_balancing_strategy":"primary","db_duration_s":0.023246,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.670167] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2b548c5a33396e70dfad5364","created_at":"2026-08-16T17:06:55.192Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.194Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2b548c5a33396e70dfad5364: start","job_status":"start","queue_duration_s":0.203378,"scheduling_latency_s":0.203394} gitlab # [ 261.670776] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.426Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2b548c5a33396e70dfad5364","created_at":"2026-08-16T17:06:55.192Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.194Z","job_size_bytes":23,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2b548c5a33396e70dfad5364: done: 0.029069 sec","job_status":"done","queue_duration_s":0.203378,"scheduling_latency_s":0.203394,"redis_calls":7,"redis_duration_s":0.0013479999999999998,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029069,"completed_at":"2026-08-16T17:06:55.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007052,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 261.726650] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.428Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1e1f1ac5b4a81edcaffcdcc6","created_at":"2026-08-16T17:06:55.324Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.326Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1e1f1ac5b4a81edcaffcdcc6: start","job_status":"start","queue_duration_s":0.101578,"scheduling_latency_s":0.101594} gitlab # [ 261.727224] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.446Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1e1f1ac5b4a81edcaffcdcc6","created_at":"2026-08-16T17:06:55.324Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.326Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1e1f1ac5b4a81edcaffcdcc6: done: 0.018501 sec","job_status":"done","queue_duration_s":0.101578,"scheduling_latency_s":0.101594,"redis_calls":7,"redis_duration_s":0.001359,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018501,"completed_at":"2026-08-16T17:06:55.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.743761] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.447Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"065e9fdadcdab034f3717692","created_at":"2026-08-16T17:06:55.331Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.334Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-065e9fdadcdab034f3717692: start","job_status":"start","queue_duration_s":0.113145,"scheduling_latency_s":0.113159} gitlab # [ 261.779629] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"065e9fdadcdab034f3717692","created_at":"2026-08-16T17:06:55.331Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.334Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-065e9fdadcdab034f3717692: done: 0.0192 sec","job_status":"done","queue_duration_s":0.113145,"scheduling_latency_s":0.113159,"redis_calls":7,"redis_duration_s":0.001578,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0192,"completed_at":"2026-08-16T17:06:55.466Z","load_balancing_strategy":"primary","db_duration_s":0.00461,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.790648] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e52ce04ba362628dd71837c2","created_at":"2026-08-16T17:06:55.340Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.342Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e52ce04ba362628dd71837c2: start","job_status":"start","queue_duration_s":0.126177,"scheduling_latency_s":0.126192} gitlab # [ 261.803123] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"e52ce04ba362628dd71837c2","created_at":"2026-08-16T17:06:55.340Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.342Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-e52ce04ba362628dd71837c2: done: 0.022281 sec","job_status":"done","queue_duration_s":0.126177,"scheduling_latency_s":0.126192,"redis_calls":10,"redis_duration_s":0.002268,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000694,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022281,"completed_at":"2026-08-16T17:06:55.490Z","load_balancing_strategy":"primary","db_duration_s":0.005463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.840089] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3cb2ab10255fb3905ced2a9a","created_at":"2026-08-16T17:06:55.342Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.343Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3cb2ab10255fb3905ced2a9a: start","job_status":"start","queue_duration_s":0.148287,"scheduling_latency_s":0.148303} gitlab # [ 261.851970] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.510Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3cb2ab10255fb3905ced2a9a","created_at":"2026-08-16T17:06:55.342Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.343Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3cb2ab10255fb3905ced2a9a: done: 0.018831 sec","job_status":"done","queue_duration_s":0.148287,"scheduling_latency_s":0.148303,"redis_calls":7,"redis_duration_s":0.001563,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018831,"completed_at":"2026-08-16T17:06:55.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.891343] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a83d581557224d31eda1a09","created_at":"2026-08-16T17:06:55.343Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.345Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a83d581557224d31eda1a09: start","job_status":"start","queue_duration_s":0.166488,"scheduling_latency_s":0.166503} gitlab # [ 261.927907] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.529Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"9a83d581557224d31eda1a09","created_at":"2026-08-16T17:06:55.343Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.345Z","job_size_bytes":19,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-9a83d581557224d31eda1a09: done: 0.017962 sec","job_status":"done","queue_duration_s":0.166488,"scheduling_latency_s":0.166503,"redis_calls":8,"redis_duration_s":0.0018510000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00144,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017962,"completed_at":"2026-08-16T17:06:55.529Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004578,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.935466] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.530Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1c3eb7c9eb3ed18c3d1b23a0","created_at":"2026-08-16T17:06:55.345Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.346Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1c3eb7c9eb3ed18c3d1b23a0: start","job_status":"start","queue_duration_s":0.18399,"scheduling_latency_s":0.184004} gitlab # [ 261.974236] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.547Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"1c3eb7c9eb3ed18c3d1b23a0","created_at":"2026-08-16T17:06:55.345Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.346Z","job_size_bytes":66,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-1c3eb7c9eb3ed18c3d1b23a0: done: 0.01635 sec","job_status":"done","queue_duration_s":0.18399,"scheduling_latency_s":0.184004,"redis_calls":7,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01635,"completed_at":"2026-08-16T17:06:55.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.998286] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.548Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"28b610667aa4f26525a0b1ef","created_at":"2026-08-16T17:06:55.347Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.348Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-28b610667aa4f26525a0b1ef: start","job_status":"start","queue_duration_s":0.199882,"scheduling_latency_s":0.199896} gitlab # [ 261.999283] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.609Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"28b610667aa4f26525a0b1ef","created_at":"2026-08-16T17:06:55.347Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.348Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-28b610667aa4f26525a0b1ef: done: 0.060999 sec","job_status":"done","queue_duration_s":0.199882,"scheduling_latency_s":0.199896,"redis_calls":7,"redis_duration_s":0.001346,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000356,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060999,"completed_at":"2026-08-16T17:06:55.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.061178] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.610Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"0c5ea8cb96604c8682c228bb","created_at":"2026-08-16T17:06:55.350Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.351Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0c5ea8cb96604c8682c228bb: start","job_status":"start","queue_duration_s":0.258569,"scheduling_latency_s":0.258588} gitlab # [ 262.061925] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.628Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"0c5ea8cb96604c8682c228bb","created_at":"2026-08-16T17:06:55.350Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.351Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0c5ea8cb96604c8682c228bb: done: 0.018449 sec","job_status":"done","queue_duration_s":0.258569,"scheduling_latency_s":0.258588,"redis_calls":7,"redis_duration_s":0.001395,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018449,"completed_at":"2026-08-16T17:06:55.628Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.110364] gitaly[902]: time="2026-08-16T17:06:55.820Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=64 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=64 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:07:25.553" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.754" grpc.time_ms=65.746 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.111101] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.630Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c8168e0d9ee561edaf202862","created_at":"2026-08-16T17:06:55.352Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.353Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c8168e0d9ee561edaf202862: start","job_status":"start","queue_duration_s":0.276875,"scheduling_latency_s":0.276912} gitlab # [ 262.111744] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.639Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c8168e0d9ee561edaf202862","created_at":"2026-08-16T17:06:55.352Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.353Z","job_size_bytes":6,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c8168e0d9ee561edaf202862: done: 0.009508 sec","job_status":"done","queue_duration_s":0.276875,"scheduling_latency_s":0.276912,"redis_calls":7,"redis_duration_s":0.0014579999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000372,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009508,"completed_at":"2026-08-16T17:06:55.639Z","load_balancing_strategy":"primary","db_duration_s":0.000443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.151432] gitaly[902]: time="2026-08-16T17:06:55.851Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSVK1BMZXCS4SKAECB88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:25.649" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:55.850" grpc.time_ms=0.579 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.152333] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.640Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2e209c02394913f5c59b4f7c","created_at":"2026-08-16T17:06:55.353Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.354Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2e209c02394913f5c59b4f7c: start","job_status":"start","queue_duration_s":0.286213,"scheduling_latency_s":0.286226} gitlab # [ 262.161042] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.657Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"2e209c02394913f5c59b4f7c","created_at":"2026-08-16T17:06:55.353Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.354Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2e209c02394913f5c59b4f7c: done: 0.016523 sec","job_status":"done","queue_duration_s":0.286213,"scheduling_latency_s":0.286226,"redis_calls":7,"redis_duration_s":0.0015209999999999998,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016523,"completed_at":"2026-08-16T17:06:55.657Z","load_balancing_strategy":"primary","db_duration_s":0.003618,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.207701] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.658Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"ba3dc7f46d3b27c220e63f27","created_at":"2026-08-16T17:06:55.392Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.393Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ba3dc7f46d3b27c220e63f27: start","job_status":"start","queue_duration_s":0.265104,"scheduling_latency_s":0.265118} gitlab # [ 262.208536] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.861Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"ba3dc7f46d3b27c220e63f27","created_at":"2026-08-16T17:06:55.392Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-8e795d5e7b6547db","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.393Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-ba3dc7f46d3b27c220e63f27: done: 0.203311 sec","job_status":"done","queue_duration_s":0.265104,"scheduling_latency_s":0.265118,"gitaly_calls":2,"gitaly_duration_s":0.072296,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.00642,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001007,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001331,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000289,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000254,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000285,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063757,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.151671232,"duration_s":0.203311,"completed_at":"2026-08-16T17:06:55.861Z","load_balancing_strategy":"primary","db_duration_s":0.067615,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 262.255764] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.863Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f382af67021ba574a15d3107","created_at":"2026-08-16T17:06:55.740Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-7309eaf728e24d58","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.742Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f382af67021ba574a15d3107: start","job_status":"start","queue_duration_s":0.120885,"scheduling_latency_s":0.120899} gitlab # [ 262.262513] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:55.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f382af67021ba574a15d3107","created_at":"2026-08-16T17:06:55.740Z","trace_propagation_headers":{"sentry-trace":"c56597bd2d7e47909ec4941d94b16adf-7309eaf728e24d58","baggage":"sentry-trace_id=c56597bd2d7e47909ec4941d94b16adf,sentry-release=Unknown"},"correlation_id":"01M05RMSVK1BMZXCS4SKAECB88","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:55.742Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f382af67021ba574a15d3107: done: 0.022831 sec","job_status":"done","queue_duration_s":0.120885,"scheduling_latency_s":0.120899,"redis_calls":7,"redis_duration_s":0.0008990000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022831,"completed_at":"2026-08-16T17:06:55.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.415560] gitaly[902]: time="2026-08-16T17:06:56.191Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMT6WSJ3QGC11AQ79SJ1M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:06.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:56.180" grpc.time_ms=10.97 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses gitlab # [ 262.480332] sidekiq-cluster[2616]: {"severity":"INFO","time":"2026-08-16T17:06:56.256Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"21cdc8b1118cafec1dc4696a","created_at":"2026-08-16T17:06:56.245Z","trace_propagation_headers":{"sentry-trace":"07520d1b2e0844c6b57b6788073be414-0d576c3be4d94386","baggage":"sentry-trace_id=07520d1b2e0844c6b57b6788073be414,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMT6WSJ3QGC11AQ79SJ1M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:56.253Z","job_size_bytes":3,"pid":2616,"sidekiq_tid":"m828","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-21cdc8b1118cafec1dc4696a: start","job_status":"start","queue_duration_s":0.002903,"scheduling_latency_s":0.002956} gitlab # [ 262.524294] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 969 gitlab # [ 262.529810] nixbot[2674]: {"ts": "2026-08-16T17:06:56.306Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e652aafceb871cb9d38ca62ebe5294ea158d1c90 \"HTTP/1.1 201 Created\""} gitlab # [ 262.578978] gitaly[902]: time="2026-08-16T17:06:56.355Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMV5HTV7PQ3KN36F0NQMA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:26.254" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:56.354" grpc.time_ms=0.844 pid=902 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 262.607756] nix-daemon[2877]: accepted connection from pid 3584, user nixbot gitlab # [ 262.612099] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses HTTP/1.1" 200 1316 "" "curl/8.21.0" 83 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e652aafceb871cb9d38ca62ebe5294ea158d1c90/statuses, in 0.17 seconds) (finished: subtest: eval and build post commit statuses, in 1.29 seconds) (finished: run the VM test script, in 331.59 seconds) gitlab # [ 262.618184] gitaly[902]: time="2026-08-16T17:06:56.394Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMT6WSJ3QGC11AQ79SJ1M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:56.393" grpc.time_ms=0.349 pid=902 span.kind=server system=grpc test script finished in 331.61s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.59 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T17:05:58.273Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'building', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T17:06:54.186566Z', 'started_at': '2026-08-16T17:06:54.577549Z', 'finished_at': None}] [{'id': 5, 'sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-16T17:06:54.555Z', 'started_at': None, 'finished_at': '2026-08-16T17:06:55.129Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded', 'created_at': '2026-08-16T17:06:54.555Z', 'started_at': None, 'finished_at': '2026-08-16T17:06:55.129Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'e652aafceb871cb9d38ca62ebe5294ea158d1c90', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-08-16T17:06:55.285Z', 'started_at': None, 'finished_at': '2026-08-16T17:06:56.237Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]