vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #433
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.T0UWAX2bMh', fmt=raw size=107374182412(finished: start all VMs, in 49.11 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 86558f25-be50-4841-956c-2ae55af051a119gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5fzqssb8bl6z091k7ahcaxag1sfxy70b-nixos-system-gitlab-test/init regInfo=/nix/store/0rzdkjckanyndf5580vm559crrpqcls7-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 540288361 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000809] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000876] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002731] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002742] Using GB pages for direct mapping73gitlab # [ 0.002916] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002922] ACPI: Early table checksum verification disabled75gitlab # [ 0.002925] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002929] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002933] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002940] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002942] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002943] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002945] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002946] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002948] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002949] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002949] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002950] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002950] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002951] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003172] No NUMA configuration found90gitlab # [ 0.003173] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003176] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005530] Zone ranges:93gitlab # [ 0.005531] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005533] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005534] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005535] Device empty97gitlab # [ 0.005535] Movable zone start for each node98gitlab # [ 0.005536] Early memory node ranges99gitlab # [ 0.005536] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005538] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005538] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005539] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005559] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005832] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.116192] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.116631] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.116647] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.116682] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.116685] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.116687] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.116688] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.116689] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.116690] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.116692] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.116693] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.116698] TSC deadline timer available117gitlab # [ 0.116703] CPU topo: Max. logical packages: 1118gitlab # [ 0.116704] CPU topo: Max. logical dies: 1119gitlab # [ 0.116704] CPU topo: Max. dies per package: 1120gitlab # [ 0.116708] CPU topo: Max. threads per core: 1121gitlab # [ 0.116708] CPU topo: Num. cores per package: 4122gitlab # [ 0.116709] CPU topo: Num. threads per package: 4123gitlab # [ 0.116709] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.116733] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.116750] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.116753] kvm-guest: setup PV sched yield127gitlab # [ 0.116768] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.116770] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.116771] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.116772] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.116774] Booting paravirtualized kernel on KVM132gitlab # [ 0.116778] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.121220] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.123788] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.123840] kvm-guest: PV spinlocks enabled136gitlab # [ 0.123842] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.123845] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5fzqssb8bl6z091k7ahcaxag1sfxy70b-nixos-system-gitlab-test/init regInfo=/nix/store/0rzdkjckanyndf5580vm559crrpqcls7-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.123939] Unknown kernel command line parameters "regInfo=/nix/store/0rzdkjckanyndf5580vm559crrpqcls7-closure-info/registration", will be passed to user space.139gitlab # [ 0.123953] random: crng init done140gitlab # [ 0.123953] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.132953] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.137280] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.137365] software IO TLB: area num 4.144gitlab # [ 0.212546] Fallback order for Node 0: 0145gitlab # [ 0.212554] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.212556] Policy zone: Normal147gitlab # [ 0.215431] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.225244] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.239048] allocated 12582912 bytes of page_ext150gitlab # [ 0.249026] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.249027] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.249903] Dynamic Preempt: lazy153gitlab # [ 0.250428] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.250429] rcu: RCU event tracing is enabled.155gitlab # [ 0.250430] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.250431] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.250431] Rude variant of Tasks RCU enabled.158gitlab # [ 0.250432] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.250432] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.250433] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.250459] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.250461] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.250462] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.254843] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.255169] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.255177] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.255290] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.258895] Console: colour VGA+ 80x25169gitlab # [ 0.258898] printk: legacy console [tty0] enabled170gitlab # [ 0.289788] printk: legacy console [ttyS0] enabled171gitlab # [ 0.397417] ACPI: Core revision 20250807172gitlab # [ 0.398344] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.399944] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.401020] x2apic enabled175gitlab # [ 0.401773] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.402704] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.404010] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.405525] kvm-guest: setup PV IPIs179gitlab # [ 0.407135] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.408197] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.410080] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.411165] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.412203] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.414078] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.415082] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.417078] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.418078] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.419077] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.420078] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.421078] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.422085] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.423079] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.425079] active return thunk: srso_alias_return_thunk194gitlab # [ 0.426100] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.427078] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.428078] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.429914] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.431078] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.432078] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.433078] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.434078] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.435967] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.437078] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.438078] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.439078] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.440078] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.470089] Freeing SMP alternatives memory: 44K208gitlab # [ 0.470932] pid_max: default: 32768 minimum: 301209gitlab # [ 0.471780] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.472184] landlock: Up and running.211gitlab # [ 0.473566] Yama: becoming mindful.212gitlab # [ 0.474292] LSM support for eBPF active213gitlab # [ 0.475317] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.476228] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.479598] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.480657] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.481083] ... version: 2218gitlab # [ 0.481832] ... bit width: 48219gitlab # [ 0.482081] ... generic counters: 6220gitlab # [ 0.482855] ... generic bitmap: 000000000000003f221gitlab # [ 0.483129] ... fixed-purpose counters: 0222gitlab # [ 0.483917] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.484808] ... value mask: 0000ffffffffffff224gitlab # [ 0.485080] ... max period: 00007fffffffffff225gitlab # [ 0.486062] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.486948] signal: max sigframe size: 3376227gitlab # [ 0.487689] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.488083] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.489174] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.494587] smp: Bringing up secondary CPUs ...231gitlab # [ 0.495506] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.496090] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.500163] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.501613] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.503337] Memory: 6011544K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260116K reserved, 0K cma-reserved)236gitlab # [ 0.505244] devtmpfs: initialized237gitlab # [ 0.506123] x86/mm: Memory block size: 128MB238gitlab # [ 0.509247] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.510164] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.511190] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.512426] PM: RTC time: 14:46:14, date: 2026-10-06242gitlab # [ 0.516037] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.518284] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.519146] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.521597] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.522092] audit: initializing netlink subsys (disabled)247gitlab # [ 0.523143] audit: type=2000 audit(1791297974.318:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.523355] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.525083] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.526080] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.527080] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.528080] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.529095] cpuidle: using governor menu254gitlab # [ 0.531350] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.532369] PCI: Using configuration type 1 for base access256gitlab # [ 0.533082] PCI: Using configuration type 1 for extended access257gitlab # [ 0.534265] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.537580] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.539018] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.539969] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.540996] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.546378] ACPI: Added _OSI(Module Device)263gitlab # [ 0.548094] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.550090] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.558038] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.564598] ACPI: Interpreter enabled267gitlab # [ 0.566157] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.568091] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.570183] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.574091] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.577563] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.590341] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.593101] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.596007] acpiphp: Slot [3] registered275gitlab # [ 0.598147] acpiphp: Slot [4] registered276gitlab # [ 0.599137] acpiphp: Slot [5] registered277gitlab # [ 0.601169] acpiphp: Slot [6] registered278gitlab # [ 0.602138] acpiphp: Slot [7] registered279gitlab # [ 0.603133] acpiphp: Slot [8] registered280gitlab # [ 0.605157] acpiphp: Slot [9] registered281gitlab # [ 0.606134] acpiphp: Slot [10] registered282gitlab # [ 0.608138] acpiphp: Slot [11] registered283gitlab # [ 0.609138] acpiphp: Slot [12] registered284gitlab # [ 0.610125] acpiphp: Slot [13] registered285gitlab # [ 0.610839] acpiphp: Slot [14] registered286gitlab # [ 0.612101] acpiphp: Slot [15] registered287gitlab # [ 0.612854] acpiphp: Slot [16] registered288gitlab # [ 0.613112] acpiphp: Slot [17] registered289gitlab # [ 0.613834] acpiphp: Slot [18] registered290gitlab # [ 0.614112] acpiphp: Slot [19] registered291gitlab # [ 0.614898] acpiphp: Slot [20] registered292gitlab # [ 0.615721] acpiphp: Slot [21] registered293gitlab # [ 0.617103] acpiphp: Slot [22] registered294gitlab # [ 0.617844] acpiphp: Slot [23] registered295gitlab # [ 0.618112] acpiphp: Slot [24] registered296gitlab # [ 0.618908] acpiphp: Slot [25] registered297gitlab # [ 0.619937] acpiphp: Slot [26] registered298gitlab # [ 0.620700] acpiphp: Slot [27] registered299gitlab # [ 0.622154] acpiphp: Slot [28] registered300gitlab # [ 0.622914] acpiphp: Slot [29] registered301gitlab # [ 0.623606] acpiphp: Slot [30] registered302gitlab # [ 0.624110] acpiphp: Slot [31] registered303gitlab # [ 0.624892] PCI host bridge to bus 0000:00304gitlab # [ 0.625697] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.627096] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.628081] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.629232] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.631095] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.633209] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.636161] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.641701] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.646280] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.653176] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.656155] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.658086] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.661087] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.664086] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.666591] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.673157] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.677205] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.680645] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.683097] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.685516] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.714247] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.716126] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.719158] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.723238] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.728410] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.738126] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.740105] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.743143] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.772106] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.777407] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.784124] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.785090] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.786105] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.788861] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.794119] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.795058] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.795909] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.798333] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.803121] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.804821] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.806140] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.809441] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.814134] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.816090] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.817103] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.819440] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.823114] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.824049] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.826105] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.828392] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.832118] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.833089] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.834103] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.835087] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.838413] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.841094] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.842110] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.844346] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.850134] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.851112] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.852103] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.854753] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.860126] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.861087] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.862111] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.866994] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.868109] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.869224] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.870224] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.872163] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.875120] iommu: Default domain type: Translated375gitlab # [ 0.875980] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.877474] ACPI: bus type USB registered377gitlab # [ 0.878158] usbcore: registered new interface driver usbfs378gitlab # [ 0.879105] usbcore: registered new interface driver hub379gitlab # [ 0.880104] usbcore: registered new device driver usb380gitlab # [ 0.882710] NetLabel: Initializing381gitlab # [ 0.883082] NetLabel: domain hash size = 128382gitlab # [ 0.883871] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.884995] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.885838] PCI: Using ACPI for IRQ routing385gitlab # [ 0.887379] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.888077] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.888077] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.891085] vgaarb: loaded389gitlab # [ 0.891896] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.892761] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.898192] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.900038] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.900825] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.902551] pnp: PnP ACPI init395gitlab # [ 0.903746] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.915920] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.919696] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.922439] NET: Registered PF_INET protocol family399gitlab # [ 0.927616] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.953554] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.955124] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.956596] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.960524] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.961981] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.963212] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.964609] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.965797] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.967336] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.968412] NET: Registered PF_XDP protocol family410gitlab # [ 0.969293] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.970358] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.971433] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.972616] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.973797] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.975245] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.976270] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.978816] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.981534] PCI: CLS 0 bytes, default 64419gitlab # [ 0.982367] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.983075] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.983488] software IO TLB: mapped [mem 0x00000000b4400000-0x00000000b8400000] (64MB)422gitlab # [ 0.986373] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.007365] Initialise system trusted keyrings424gitlab # [ 1.008700] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.020428] Key type asymmetric registered426gitlab # [ 1.021181] Asymmetric key parser 'x509' registered427gitlab # [ 1.022189] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.024145] io scheduler mq-deadline registered429gitlab # [ 1.026399] io scheduler kyber registered430gitlab # [ 1.032974] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.036300] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.041816] Linux agpgart interface v0.103433gitlab # [ 1.043800] ACPI: bus type drm_connector registered434gitlab # [ 1.048676] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.051403] usbserial: USB Serial support registered for generic436gitlab # [ 1.053885] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.053885] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.059448] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.063011] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.066039] NET: Registered PF_INET6 protocol family441gitlab # [ 1.069742] Segment Routing with IPv6442gitlab # [ 1.071571] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.075543] IPI shorthand broadcast: enabled444gitlab # [ 1.084525] sched_clock: Marking stable (937034556, 146900445)->(1110302438, -26367437)445gitlab # [ 1.086893] registered taskstats version 1446gitlab # [ 1.088032] Loading compiled-in X.509 certificates447gitlab # [ 1.098316] Demotion targets for Node 0: null448gitlab # [ 1.099516] Key type .fscrypt registered449gitlab # [ 1.100244] Key type fscrypt-provisioning registered450gitlab # [ 1.101340] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.102347] ima: Allocated hash algorithm: sha1452gitlab # [ 1.103218] ima: No architecture policies found453gitlab # [ 1.104476] PM: Magic number: 14:196:788454gitlab # [ 1.106220] RAS: Correctable Errors collector initialized.455gitlab # [ 1.110801] clk: Disabling unused clocks456gitlab # [ 1.111533] PM: genpd: Disabling unused power domains457gitlab # [ 1.296356] Freeing initrd memory: 29392K458gitlab # [ 1.303778] Freeing unused decrypted memory: 2028K459gitlab # [ 1.310213] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.312962] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.317861] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.321848] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.390071] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.391270] Run /init as init process465gitlab # [ 1.405615] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.429646] fuse: init (API version 7.45)467gitlab # [ 1.438682] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.447383] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.450974] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.494676] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.830730] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.860500] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.861410] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.862287] systemd[1]: Running in initrd.475gitlab # [ 1.863422] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.864626] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.966301] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.008732] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.017590] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.018779] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.020313] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.021503] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.022662] systemd[1]: Reached target Path Units.484gitlab # [ 2.023548] systemd[1]: Reached target Slice Units.485gitlab # [ 2.024471] systemd[1]: Reached target Swaps.486gitlab # [ 2.025290] systemd[1]: Reached target Timer Units.487gitlab # [ 2.026320] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.027561] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.028745] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.029802] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.030887] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.031873] systemd[1]: Reached target Socket Units.493gitlab # [ 2.033981] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.036134] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.038266] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.042987] systemd[1]: Starting Journal Service...497gitlab # [ 2.045318] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.046342] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.055992] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.061991] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.068483] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...502gitlab # [ 2.072219] systemd[1]: modprobe@configfs.service: Deactivated successfully.503gitlab # [ 2.073499] systemd-journald[92]: Collecting audit messages is disabled.504gitlab # [ 2.080177] systemd[1]: Finished Load Kernel Module configfs.505gitlab # [ 2.081775] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 2.100508] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.104214] netfs: FS-Cache loaded508gitlab # [ 2.105128] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.108038] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.510gitlab # [ 2.113030] systemd[1]: Starting Create Static Device Nodes in /dev...511gitlab # [ 2.116652] 9pnet: Installing 9P2000 support512gitlab # [ 2.120729] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.123064] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.126420] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 1.980993] systemd-modules-load[94]: Using 4 probe threads516gitlab # [ 2.128849] systemd[1]: Finished Load Kernel Module 9pnet_virtio.517gitlab # [ 1.982508] systemd-modules-load[94]: Inserted module 'virtio_balloon'518gitlab # [ 2.130193] systemd[1]: Started Journal Service.519gitlab # [ 1.984298] systemd-modules-load[94]: Inserted module 'dm_mod'520gitlab # [ 1.985762] systemd-modules-load[94]: Inserted module 'virtio_gpu'521gitlab # [ 1.986978] systemd[1]: Finished Create Static Device Nodes in /dev.522gitlab # [ 1.992164] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 1.993545] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.994554] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.996292] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.998530] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.011861] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.020064] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 2.031699] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.059527] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.060408] systemd[1]: Reached target System Initialization.532gitlab # [ 2.061230] systemd[1]: Reached target Basic System.533gitlab # [ 2.279926] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.283131] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)535gitlab # [ 2.285097] uhci_hcd 0000:00:01.2: UHCI Host Controller536gitlab # [ 2.287000] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1537gitlab # [ 2.288391] uhci_hcd 0000:00:01.2: detected 2 ports538gitlab # [ 2.294422] virtio_blk virtio5: 4/0/0 default/read/poll queues539gitlab # [ 2.295453] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140540gitlab # [ 2.296970] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18541gitlab # [ 2.298312] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1542gitlab # [ 2.299460] usb usb1: Product: UHCI Host Controller543gitlab # [ 2.300232] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd544gitlab # [ 2.301061] usb usb1: SerialNumber: 0000:00:01.2545gitlab # [ 2.304798] virtio_blk virtio5: [vdb] 11953048 512-byte logical blocks (6.12 GB/5.70 GiB)546gitlab # [ 2.311446] SCSI subsystem initialized547gitlab # [ 2.321130] hub 1-0:1.0: USB hub found548gitlab # [ 2.322038] hub 1-0:1.0: 2 ports detected549gitlab # [ 2.336213] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12550gitlab # [ 2.338348] serio: i8042 KBD port at 0x60,0x64 irq 1551gitlab # [ 2.339798] serio: i8042 AUX port at 0x60,0x64 irq 12552gitlab # [ 2.341004] scsi host0: ata_piix553gitlab # [ 2.341928] scsi host1: ata_piix554gitlab # [ 2.342530] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.343724] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.235930] systemd[1]: Starting Virtual Console Setup...557gitlab # [ 2.250115] systemd[1]: Found device /dev/disk/by-label/nixos.558gitlab # [ 2.251144] systemd[1]: Reached target Initrd Root Device.559gitlab # [ 2.251984] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...560gitlab # [ 2.256882] systemd[1]: Found device /dev/disk/by-label/nix-store.561gitlab # [ 2.261818] systemd-vconsole-setup[149]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.263946] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.280848] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks564gitlab # [ 2.285104] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.565gitlab # [ 2.506286] ata2: found unknown device (class 0)566gitlab # [ 2.509349] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100567gitlab # [ 2.514068] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5568gitlab # [ 2.554034] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0569gitlab # [ 2.555034] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.426741] (udev-worker)[138]: Network interface NamePolicy= disabled on kernel command line.571gitlab # [ 2.430998] (udev-worker)[128]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.572gitlab # [ 2.436729] (udev-worker)[128]: Network interface NamePolicy= disabled on kernel command line.573gitlab # [ 2.602350] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.635683] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.725230] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.728788] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.731533] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.733247] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.734774] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.765830] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.780105] usbcore: registered new interface driver usbhid582gitlab # [ 2.782250] usbhid: USB HID core driver583gitlab # [ 2.791616] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.795129] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.914123] systemd[1]: Mounting /sysroot...586gitlab # [ 3.220952] EXT4-fs (vda): mounted filesystem 86558f25-be50-4841-956c-2ae55af051a1 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.081370] systemd[1]: Mounted /sysroot.588gitlab # [ 3.082558] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.086513] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.088538] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.092122] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.093952] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.101821] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.106060] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.260439] 9p: Installing v9fs 9p2000 file system support596gitlab # [ 3.114505] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.115719] systemd[1]: Mounted /sysroot/run.598gitlab # [ 3.123055] systemd[1]: Starting rw-sysroot-nix-store.service...599gitlab # [ 3.124067] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 3.273370] erofs (device vdb): mounted with root inode @ nid 128.601gitlab # [ 3.129218] systemd[1]: Mounted /sysroot/nix/.ro-store.602gitlab # [ 3.132450] systemd[1]: Mounted /sysroot/tmp/xchg.603gitlab # [ 3.133426] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload.604gitlab # [ 3.136067] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.605gitlab # [ 3.137368] systemd[1]: Finished rw-sysroot-nix-store.service.606gitlab # [ 3.138837] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)...607gitlab # [ 3.140325] systemd[1]: Reloading...608gitlab # [ 3.203085] systemd[1]: Reloading finished in 61 ms.609gitlab # [ 3.223478] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace...610gitlab # [ 3.226540] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace...611gitlab # [ 3.229539] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.231810] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.234424] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.236742] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.252658] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.255249] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.915089] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.972159] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.974295] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.976294] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.978471] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.009452] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.012704] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.028202] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.030231] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.032551] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.063755] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.065794] systemd[1]: Stopped target Basic System.629gitlab # [ 4.067540] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.069448] systemd[1]: Stopped target Path Units.631gitlab # [ 4.071178] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.073612] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.076220] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.077951] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.079752] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.082190] systemd[1]: Stopped target Swaps.637gitlab # [ 4.085073] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.086975] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.091470] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.094355] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.097457] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.098886] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.101885] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.103609] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.105507] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.107164] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.109216] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.110593] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.112639] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.114693] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.116517] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.117715] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.118802] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.120055] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.121456] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.122555] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.123937] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.125229] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.126247] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.127475] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.128609] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.129610] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.130436] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.131352] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.132346] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.133359] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.134106] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.134889] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.135984] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.136893] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.138043] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.139050] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.140486] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.150639] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.151885] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.152658] systemd[1]: Reached target Switch Root.677gitlab # [ 4.153390] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.284757] initrd-nixos-activation-start[225]: booting system configuration /nix/store/5fzqssb8bl6z091k7ahcaxag1sfxy70b-nixos-system-gitlab-test679gitlab # [ 4.329578] initrd-nixos-activation-start[225]: running activation script...680gitlab # [ 4.594461] initrd-nixos-activation-start[248]: setting up /etc...681gitlab # [ 4.693601] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.696481] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.698327] systemd[1]: Starting Switch Root...684gitlab # [ 4.735514] systemd[1]: Switching root.685gitlab # [ 4.944358] systemd-journald[92]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.070087] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.452056] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.462499] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.464402] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.466375] systemd[1]: Detected first boot.691gitlab # [ 5.468861] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.611560] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.712494] systemd[1]: Applying preset policy.694gitlab # [ 5.908433] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 6.034934] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 6.036326] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 6.039025] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 6.041460] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 6.042811] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 6.044486] systemd[1]: Created slice User and Session Slice.701gitlab # [ 6.045443] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 6.046692] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 6.047943] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 6.048705] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 6.049571] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 6.050434] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 6.051208] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 6.052109] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 6.053150] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 6.054137] systemd[1]: Reached target Path Units.711gitlab # [ 6.054870] systemd[1]: Reached target Remote File Systems.712gitlab # [ 6.055735] systemd[1]: Reached target Slice Units.713gitlab # [ 6.056470] systemd[1]: Reached target Swaps.714gitlab # [ 6.058177] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 6.060290] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 6.061722] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 6.063345] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 6.064328] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 6.067006] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 6.068513] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 6.070631] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 6.071856] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 6.073131] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 6.074587] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 6.077345] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 6.078490] systemd[1]: Listening on udev Control Socket.727gitlab # [ 6.079438] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 6.082772] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.084997] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.087377] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.090969] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.105926] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.107053] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.111767] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.112691] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.114630] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.117287] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.136998] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.138985] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.144156] systemd[1]: Starting Journal Service...741gitlab # [ 6.146278] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.164353] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.167975] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.169014] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.174156] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.179572] systemd-journald[319]: Collecting audit messages is enabled.747gitlab # [ 6.181703] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.182767] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.183807] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.185146] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.186210] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 6.188388] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 6.189689] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 6.191231] systemd[1]: Finished Load Kernel Module configfs.755gitlab # [ 6.192373] systemd[1]: Mounted FUSE Control File System.756gitlab # [ 6.195129] systemd[1]: Mounting Kernel Configuration File System...757gitlab # [ 6.201335] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...758gitlab # [ 6.202629] EXT4-fs (vda): re-mounted 86558f25-be50-4841-956c-2ae55af051a1.759gitlab # [ 6.060112] systemd[1]: Queued start job for default target Multi-User System.760gitlab # [ 6.064031] systemd[1]: Unnecessary job was removed for /dev/vdb.761gitlab # [ 6.211617] loop: module loaded762gitlab # [ 6.066119] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 6.067515] systemd-modules-load[320]: Using 3 probe threads764gitlab # [ 6.214509] systemd[1]: Started Journal Service.765gitlab # [ 6.068709] systemd-modules-load[320]: Inserted module 'tls'766gitlab # [ 6.069979] systemd-modules-load[320]: Inserted module 'loop'767gitlab # [ 6.071182] systemd[1]: Finished Load Kernel Modules.768gitlab # [ 6.072238] systemd[1]: Finished Remount Root and Kernel File Systems.769gitlab # [ 6.073679] systemd[1]: Mounted Kernel Configuration File System.770gitlab # [ 6.080209] systemd[1]: Listening on Disk Image Download Service Socket.771gitlab # [ 6.082226] systemd[1]: Starting Firewall...772gitlab # [ 6.084234] systemd[1]: Starting Flush Journal to Persistent Storage...773gitlab # [ 6.085398] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore774gitlab # [ 6.090233] systemd[1]: Starting Load/Save OS Random Seed...775gitlab # [ 6.094142] systemd[1]: Starting Apply Kernel Variables...776gitlab # [ 6.095727] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 6.097230] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.778gitlab # [ 6.104921] systemd[1]: Starting Create Static Device Nodes in /dev...779gitlab # [ 6.106394] systemd-oomd[321]: No swap; memory pressure usage will be degraded780gitlab # [ 6.254954] systemd-journald[319]: Received client request to flush runtime journal.781gitlab # [ 6.150567] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.782gitlab # [ 6.152986] systemd[1]: Finished Load/Save OS Random Seed.783gitlab # [ 6.153962] systemd[1]: Reached target First Boot Complete.784gitlab # [ 6.154970] systemd[1]: Finished Apply Kernel Variables.785gitlab # [ 6.155717] systemd[1]: Finished Create Static Device Nodes in /dev.786gitlab # [ 6.156603] systemd[1]: Reached target Preparation for Local File Systems.787gitlab # [ 6.157611] systemd[1]: Starting Rule-based Manager for Device Events and Files...788gitlab # [ 6.158670] systemd[1]: Finished Flush Journal to Persistent Storage.789gitlab # [ 6.168023] systemd-udevd[352]: Using default interface naming scheme 'v261'.790gitlab # [ 6.197409] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.206403] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.288729] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.307197] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.347143] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.795gitlab # [ 6.359052] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.360579] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 6.362830] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.378706] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.380137] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.381844] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.384187] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.385851] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.387134] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.536824] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3805gitlab # [ 6.556667] mousedev: PS/2 mouse device common for all mice806gitlab # [ 6.559955] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console807gitlab # [ 6.561250] ACPI: button: Power Button [PWRF]808gitlab # [ 6.575105] Console: switching to colour dummy device 80x25809gitlab # [ 6.577763] [drm] Found bochs VGA, ID 0xb0c5.810gitlab # [ 6.577765] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.811gitlab # [ 6.580772] Floppy drive(s): fd0 is 2.88M AMI BIOS812gitlab # [ 6.583075] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0813gitlab # [ 6.584007] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD814gitlab # [ 6.592364] FDC 0 is a S82078B815gitlab # [ 6.596447] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic816gitlab # [ 6.597711] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0817gitlab # [ 6.454352] systemd[1]: Finished Firewall.818gitlab # [ 6.606789] rtc_cmos 00:05: RTC can wake from S4819gitlab # [ 6.614795] rtc_cmos 00:05: registered as rtc0820gitlab # [ 6.615135] rtc_cmos 00:05: setting system clock to 2026-10-06T14:46:20 UTC (1791297980)821gitlab # [ 6.616062] parport_pc 00:03: reported by Plug and Play ACPI822gitlab # [ 6.621266] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]823gitlab # [ 6.623791] Console: switching to colour frame buffer device 160x50824gitlab # [ 6.624224] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4825gitlab # [ 6.624420] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 6.624777] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device827gitlab # [ 6.638586] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6828gitlab # [ 6.641419] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 6.535231] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 6.545376] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 6.547724] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 6.549430] systemd[1]: Starting Virtual Console Setup...833gitlab # [ 6.698852] ppdev: user-space parallel port driver834gitlab # [ 6.553604] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.835gitlab # [ 6.554739] systemd[1]: Stopped Virtual Console Setup.836gitlab # [ 6.555568] systemd[1]: Starting Virtual Console Setup...837gitlab # [ 6.629883] systemd-vconsole-setup[491]: Configuration of first virtual console was skipped, ignoring remaining ones.838gitlab # [ 6.631940] systemd[1]: Finished Virtual Console Setup.839gitlab # [ 6.825537] kvm_amd: TSC scaling supported840gitlab # [ 6.826125] kvm_amd: Nested Virtualization enabled841gitlab # [ 6.826650] kvm_amd: Nested Paging enabled842gitlab # [ 6.827125] kvm_amd: LBR virtualization supported843gitlab # [ 6.827663] kvm_amd: Virtual VMLOAD VMSAVE supported844gitlab # [ 6.828244] kvm_amd: Virtual GIF supported845gitlab # [ 6.828683] kvm_amd: Virtual NMI enabled846gitlab # [ 6.865711] EDAC MC: Ver: 3.0.0847gitlab # [ 6.893510] systemd[1]: Mounting /run/wrappers...848gitlab # [ 6.920291] systemd[1]: Mounted /run/wrappers.849gitlab # [ 6.922131] systemd[1]: Reached target Local File Systems.850gitlab # [ 6.924055] systemd[1]: Listening on Boot Loader Control Service Socket.851gitlab # [ 6.926494] systemd[1]: Starting register-nix-paths.service...852gitlab # [ 6.928935] systemd[1]: Starting Create SUID/SGID Wrappers...853gitlab # [ 6.931190] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.854gitlab # [ 6.934444] systemd[1]: Starting Save Transient machine-id to Disk...855gitlab # [ 6.936680] systemd[1]: Starting Create System Files and Directories...856gitlab # [ 6.976950] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.857gitlab # [ 6.979503] systemd[1]: Finished Save Transient machine-id to Disk.858gitlab # [ 6.983389] systemd[1]: Finished Create System Files and Directories.859gitlab # [ 6.988674] systemd[1]: Starting Rebuild Journal Catalog...860gitlab # [ 6.991480] systemd[1]: Starting Record System Boot/Shutdown in UTMP...861gitlab # [ 7.014462] systemd[1]: Finished Record System Boot/Shutdown in UTMP.862gitlab # [ 7.028209] systemd[1]: Finished Rebuild Journal Catalog.863gitlab # [ 7.031251] systemd[1]: Starting Update is Completed...864gitlab # [ 7.045815] systemd[1]: Finished Update is Completed.865gitlab # [ 7.086601] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.866gitlab # [ 7.088053] systemd[1]: Finished Create SUID/SGID Wrappers.867gitlab # [ 7.402505] systemd[1]: Finished register-nix-paths.service.868gitlab # [ 7.404369] systemd[1]: Reached target System Initialization.869gitlab # [ 7.405968] systemd[1]: Started Discard unused filesystem blocks once a week.870gitlab # [ 7.407982] systemd[1]: Started logrotate.timer.871gitlab # [ 7.409278] systemd[1]: Started Daily Cleanup of Temporary Directories.872gitlab # [ 7.411108] systemd[1]: Reached target Timer Units.873gitlab # [ 7.412436] systemd[1]: Listening on D-Bus System Message Bus Socket.874gitlab # [ 7.414197] systemd[1]: Listening on Nix Daemon Socket.875gitlab # [ 7.415617] systemd[1]: Starting nixbot CI service socket...876gitlab # [ 7.417207] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.877gitlab # [ 7.419659] systemd[1]: Listening on nixbot CI service socket.878gitlab # [ 7.421235] systemd[1]: Reached target Socket Units.879gitlab # [ 7.422553] systemd[1]: Starting D-Bus System Message Bus...880gitlab # [ 7.499770] dbus-broker-launch[573]: Looking up NSS user entry for 'systemd-timesync'...881gitlab # [ 7.502648] dbus-broker-launch[573]: NSS returned no entry for 'systemd-timesync'882gitlab # [ 7.505266] dbus-broker-launch[573]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"883gitlab # [ 7.510814] systemd[1]: Started D-Bus System Message Bus.884gitlab # [ 7.530526] dbus-broker-launch[573]: Ready885gitlab # [ 7.533282] systemd[1]: Reached target Basic System.886gitlab # [ 7.536440] systemd[1]: Started backdoor.service.887gitlab # [ 7.540159] systemd[1]: Starting gitlab-config.service...888gitlab # [ 7.547597] systemd[1]: Starting Import lastlog data into lastlog2 database...889gitlab # [ 7.554456] systemd[1]: Starting Logrotate configuration check...890gitlab # [ 7.562950] systemd[1]: Starting Name Service Cache Daemon (nsncd)...891gitlab # [ 7.565651] systemd[1]: Starting Post-Boot Actions...892gitlab # [ 7.571565] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.577690] systemd[1]: Starting resolvconf update...894gitlab # connecting to host...895gitlab: Guest shell says: b'Spawning backdoor root shell...\n'896gitlab: connected to guest root shell897gitlab # [ 7.597460] logrotate[578]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.898gitlab: (connecting took 8.29 seconds)899gitlab # [ 7.598149] logrotate[578]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf900gitlab: (finished: waiting for the VM to finish booting, in 8.29 seconds)901gitlab # [ 7.598823] logrotate[578]: note: 'monthly' overrides previously specified 'weekly'902gitlab # [ 7.599413] logrotate[578]: Reading state from file: /var/lib/logrotate.status903gitlab # [ 7.599886] logrotate[578]: state file /var/lib/logrotate.status does not exist904gitlab # [ 7.600389] logrotate[578]: Allocating hash table for state file, size 64 entries905gitlab # [ 7.600904] logrotate[578]: Handling 4 logs906gitlab # [ 7.601453] logrotate[578]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed907gitlab # [ 7.601922] logrotate[578]: considering log /var/log/btmp908gitlab # [ 7.602495] logrotate[578]: Creating new state909gitlab # [ 7.602960] logrotate[578]: Now: 2026-10-06 14:46910gitlab # [ 7.603545] logrotate[578]: Last rotated at 2026-10-06 14:00911gitlab # [ 7.605299] logrotate[578]: log does not need rotating (log has already been rotated)912gitlab # [ 7.606445] logrotate[578]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed913gitlab # [ 7.607135] logrotate[578]: considering log /var/log/wtmp914gitlab # [ 7.607563] logrotate[578]: Creating new state915gitlab # [ 7.608090] logrotate[578]: Now: 2026-10-06 14:46916gitlab # [ 7.608582] logrotate[578]: Last rotated at 2026-10-06 14:00917gitlab # [ 7.610638] logrotate[578]: log does not need rotating (log has already been rotated)918gitlab # [ 7.611500] logrotate[578]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed919gitlab # [ 7.611730] logrotate[578]: switching euid from 0 to 165 and egid from 0 to 165 (pid 578)920gitlab # [ 7.612404] logrotate[578]: considering log /var/gitlab/state/log/*.log921gitlab # [ 7.612701] logrotate[578]: log /var/gitlab/state/log/*.log does not exist -- skipping922gitlab # [ 7.613372] logrotate[578]: Creating new state923gitlab # [ 7.613883] logrotate[578]: switching euid from 165 to 0 and egid from 165 to 0 (pid 578)924gitlab # [ 7.615700] logrotate[578]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed925gitlab # [ 7.616244] logrotate[578]: switching euid from 0 to 60 and egid from 0 to 60 (pid 578)926gitlab # [ 7.616669] logrotate[578]: considering log /var/log/nginx/*.log927gitlab # [ 7.617194] logrotate[578]: log /var/log/nginx/*.log does not exist -- skipping928gitlab # [ 7.617689] logrotate[578]: Creating new state929gitlab # [ 7.618204] logrotate[578]: not running postrotate script, since no logs were rotated930gitlab # [ 7.618725] logrotate[578]: switching euid from 60 to 0 and egid from 60 to 0 (pid 578)931gitlab # [ 7.619343] systemd[1]: Finished Logrotate configuration check.932gitlab # [ 7.619910] systemd[1]: Finished Post-Boot Actions.933gitlab # [ 7.638158] nsncd[579]: Oct 06 14:46:21.669 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"934gitlab # [ 7.645200] systemd[1]: Started Name Service Cache Daemon (nsncd).935gitlab # [ 7.646194] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 7.647315] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 7.649108] systemd[1]: Starting User Login Management...938gitlab # [ 7.650633] systemd[1]: Finished Import lastlog data into lastlog2 database.939gitlab # [ 7.659822] systemd[1]: Stopped target Host and Network Name Lookups.940gitlab # [ 7.660607] systemd[1]: Stopping Host and Network Name Lookups...941gitlab # [ 7.661671] systemd[1]: Stopped target User and Group Name Lookups.942gitlab # [ 7.662495] systemd[1]: Stopping User and Group Name Lookups...943gitlab # [ 7.662977] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...944gitlab # [ 7.664358] systemd[1]: nscd.service: Deactivated successfully.945gitlab # [ 7.666295] systemd[1]: Stopped Name Service Cache Daemon (nsncd).946gitlab # [ 7.666902] systemd[1]: nscd.service: Consumed 20ms CPU time over 102ms wall clock time, 7.2M memory peak, 5.5M read from disk.947gitlab # [ 7.674205] systemd[1]: Starting Name Service Cache Daemon (nsncd)...948gitlab # [ 7.692394] nsncd[670]: Oct 06 14:46:21.723 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"949gitlab # [ 7.692967] systemd[1]: Finished resolvconf update.950gitlab # [ 7.693639] systemd[1]: Started Name Service Cache Daemon (nsncd).951gitlab # [ 7.693972] systemd[1]: Reached target Preparation for Network.952gitlab # [ 7.694661] systemd[1]: Reached target Host and Network Name Lookups.953gitlab # [ 7.695246] systemd[1]: Reached target User and Group Name Lookups.954gitlab # [ 7.696300] systemd[1]: Starting DHCP Client...955gitlab # [ 7.699742] systemd-logind[643]: New seat seat0.956gitlab # [ 7.701928] systemd[1]: Starting Address configuration of eth1...957gitlab # [ 7.704082] systemd[1]: Starting Extra networking commands....958gitlab # [ 7.706723] systemd-logind[643]: Watching system buttons on /dev/input/event2 (Power Button)959gitlab # [ 7.707291] systemd-logind[643]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)960gitlab # [ 7.708065] systemd-logind[643]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)961gitlab # [ 7.710223] systemd[1]: Started User Login Management.962gitlab # [ 7.714419] systemd[1]: Starting linger-users.service...963gitlab # [ 7.732026] network-addresses-eth1-start[693]: adding address 192.168.1.1/24... done964gitlab # [ 7.733640] systemd[1]: linger-users.service: Deactivated successfully.965gitlab # [ 7.734560] systemd[1]: Finished linger-users.service.966gitlab # [ 7.737584] network-addresses-eth1-start[693]: adding address 2001:db8:1::1/64... done967gitlab # [ 7.743553] systemd[1]: Finished Address configuration of eth1.968gitlab # [ 7.779345] systemd[1]: Finished Extra networking commands..969gitlab # [ 7.782058] systemd[1]: Reached target Network.970gitlab # [ 7.783545] dhcpcd[707]: dhcpcd-10.3.2 starting971gitlab # [ 7.784476] systemd[1]: Starting gitlab-workhorse.service...972gitlab # [ 7.787734] dhcpcd[762]: dev: loaded udev973gitlab # [ 7.788496] systemd[1]: Starting Nginx Web Server...974gitlab # [ 7.790868] systemd[1]: Starting PostgreSQL Server...975gitlab # [ 7.941455] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.942162] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.796170] systemd[1]: Starting Redis Server - redis-gitlab...978gitlab # [ 7.798553] systemd[1]: Starting Permit User Sessions...979gitlab # [ 7.808090] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.980gitlab # [ 7.822412] systemd[1]: Finished Permit User Sessions.981gitlab # [ 7.829072] systemd[1]: Started Getty on tty1.982gitlab # [ 7.831048] systemd[1]: Reached target Login Prompts.983gitlab # [ 8.044132] cfg80211: Loading compiled-in X.509 certificates for regulatory database984gitlab # [ 8.049965] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'985gitlab # [ 8.050826] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'986gitlab # [ 8.052387] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2987gitlab # [ 8.053438] cfg80211: failed to load regulatory.db988gitlab # [ 7.923333] nginx-pre-start[784]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok989gitlab # [ 7.923738] nginx-pre-start[784]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful990gitlab # [ 7.930105] systemd[1]: Started Nginx Web Server.991gitlab # [ 8.085159] 8021q: adding VLAN 0 to HW filter on device eth0992gitlab # [ 7.940263] dhcpcd[762]: eth0: waiting for carrier993gitlab # [ 7.941733] dhcpcd[762]: eth0: carrier acquired994gitlab # [ 7.944749] dhcpcd[762]: DUID 00:01:00:01:32:57:c6:3d:52:54:00:12:34:56995gitlab # [ 7.945761] dhcpcd[762]: eth0: IAID 00:12:34:56996gitlab # [ 7.946411] dhcpcd[762]: eth0: adding address fe80::5054:ff:fe12:3456997gitlab # [ 7.963806] postgresql-pre-start[789]: The files belonging to this database system will be owned by user "postgres".998gitlab # [ 7.964578] postgresql-pre-start[789]: This user must also own the server process.999gitlab # [ 7.967296] redis-server[785]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1000gitlab # [ 7.968085] redis-server[785]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1001gitlab # [ 7.968839] redis-server[785]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=785, just started1002gitlab # [ 7.970345] redis-server[785]: Configuration loaded1003gitlab # [ 7.973161] dhcpcd[762]: eth0: soliciting a DHCP lease1004gitlab # [ 7.975105] redis[785]: monotonic clock: POSIX clock_gettime1005gitlab # [ 7.975809] postgresql-pre-start[789]: The database cluster will be initialized with locale "en_US.UTF-8".1006gitlab # [ 7.976719] postgresql-pre-start[789]: The default database encoding has accordingly been set to "UTF8".1007gitlab # [ 7.977541] postgresql-pre-start[789]: The default text search configuration will be set to "english".1008gitlab # [ 7.978086] postgresql-pre-start[789]: Data page checksums are enabled.1009gitlab # [ 7.978633] postgresql-pre-start[789]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1010gitlab # [ 7.979137] postgresql-pre-start[789]: creating subdirectories ... ok1011gitlab # [ 7.979625] postgresql-pre-start[789]: selecting dynamic shared memory implementation ... posix1012gitlab # [ 8.131048] NET: Registered PF_PACKET protocol family1013gitlab # [ 7.986133] redis[785]: Running mode=standalone, port=0.1014gitlab # [ 7.987687] redis[785]: Server initialized1015gitlab # [ 7.988575] redis[785]: Ready to accept connections unix1016gitlab # [ 7.989262] systemd[1]: Started Redis Server - redis-gitlab.1017gitlab # [ 7.990420] redis[785]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1018gitlab # [ 7.992928] dhcpcd[762]: eth0: offered 10.0.2.15 from 10.0.2.21019gitlab # [ 7.996219] dhcpcd[762]: eth0: probing address 10.0.2.15/241020gitlab # [ 8.011658] postgresql-pre-start[789]: selecting default "max_connections" ... 1001021gitlab # [ 8.061430] postgresql-pre-start[789]: selecting default "shared_buffers" ... 128MB1022gitlab # [ 8.316449] systemd[1]: Started gitlab-workhorse.service.1023gitlab # [ 8.476549] postgresql-pre-start[789]: selecting default time zone ... UTC1024gitlab # [ 8.478445] postgresql-pre-start[789]: creating configuration files ... ok1025gitlab # [ 8.544456] gitlab-workhorse[822]: time="2026-10-06T14:46:22Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41026gitlab # [ 8.545214] gitlab-workhorse[822]: time="2026-10-06T14:46:22Z" level=info msg="Using redis/go-redis"1027gitlab # [ 8.545687] gitlab-workhorse[822]: time="2026-10-06T14:46:22Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1028gitlab # [ 8.651973] postgresql-pre-start[789]: running bootstrap script ... ok1029gitlab # [ 9.116985] postgresql-pre-start[789]: performing post-bootstrap initialization ... ok1030gitlab # [ 9.352073] postgresql-pre-start[789]: syncing data to disk ... ok1031gitlab # [ 9.353974] postgresql-pre-start[789]: initdb: warning: enabling "trust" authentication for local connections1032gitlab # [ 9.355296] postgresql-pre-start[789]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1033gitlab # [ 9.356451] postgresql-pre-start[789]: Success. You can now start the database server using:1034gitlab # [ 9.358076] postgresql-pre-start[789]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1035gitlab # [ 9.493422] postgres[846]: [846] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1036gitlab # [ 9.497483] postgres[846]: [846] LOG: listening on IPv6 address "::1", port 54321037gitlab # [ 9.500517] postgres[846]: [846] LOG: listening on IPv4 address "127.0.0.1", port 54321038gitlab # [ 9.503629] postgres[846]: [846] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1039gitlab # [ 9.511404] postgres[860]: [860] LOG: database system was shut down at 2026-10-06 14:46:23 GMT1040gitlab # [ 9.518734] postgres[846]: [846] LOG: database system is ready to accept connections1041gitlab # [ 9.525558] systemd[1]: Started PostgreSQL Server.1042gitlab # [ 9.529690] systemd[1]: Starting PostgreSQL Setup Scripts...1043gitlab # [ 9.643777] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: mkdir -p /var/gitlab/state/home/.ssh: OK1044gitlab # [ 9.647166] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[854]: chmod 700 /var/gitlab/state/home/.ssh: OK1045gitlab # [ 9.699873] postgresql-setup-start[872]: CREATE DATABASE1046gitlab # [ 9.711955] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 9.715356] systemd[1]: Started gitaly.service.1048gitlab # [ 9.719676] postgresql-setup-start[888]: CREATE ROLE1049gitlab # [ 9.736591] postgresql-setup-start[896]: ALTER DATABASE1050gitlab # [ 9.758493] postgresql-setup-start[907]: CREATE ROLE1051gitlab # [ 9.760830] systemd[1]: Finished PostgreSQL Setup Scripts.1052gitlab # [ 9.762889] systemd[1]: Reached target PostgreSQL.1053gitlab # [ 9.765954] systemd[1]: Starting gitlab-db-config.service...1054gitlab # [ 9.767465] systemd[1]: Starting gitlab-postgresql.service...1055gitlab # [ 9.868750] gitlab-postgresql-start[917]: CREATE DATABASE1056gitlab # [ 9.904424] gitlab-postgresql-start[922]: CREATE EXTENSION1057gitlab # [ 9.991652] gitlab-postgresql-start[924]: CREATE EXTENSION1058gitlab # [ 9.997938] systemd[1]: Finished gitlab-postgresql.service.1059gitlab # [ 10.245142] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8911060gitlab # [ 10.246453] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8911061gitlab # [ 10.247296] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8911062gitlab # [ 10.248089] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8911063gitlab # [ 10.248737] gitaly[891]: time="2026-10-06T14:46:24.276Z" level=info msg="Starting Gitaly" pid=891 version=1064gitlab # [ 10.315878] dhcpcd[762]: eth0: soliciting an IPv6 router1065gitlab # [ 10.316975] dhcpcd[762]: eth0: Router Advertisement from fe80::21066gitlab # [ 10.317734] dhcpcd[762]: eth0: adding address fec0::5054:ff:fe12:3456/641067gitlab # [ 10.318585] dhcpcd[762]: eth0: adding route to fec0::/641068gitlab # [ 10.319159] dhcpcd[762]: eth0: adding default route via fe80::21069gitlab # [ 10.444304] gitaly[891]: time="2026-10-06T14:46:24.476Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=188 pid=8911070gitlab # [ 10.445368] gitaly[891]: time="2026-10-06T14:46:24.476Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8911071gitlab # [ 10.448202] gitaly[891]: time="2026-10-06T14:46:24.480Z" level=info msg="finished initializing command factory" duration_ms=3 pid=8911072gitlab # [ 10.448941] gitaly[891]: time="2026-10-06T14:46:24.480Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-891/git-exec-3134435211.d/git pid=8911073gitlab # [ 10.456622] gitaly[891]: time="2026-10-06T14:46:24.488Z" level=info msg="finished detecting git version" duration_ms=8 pid=8911074gitlab # [ 10.457171] gitaly[891]: time="2026-10-06T14:46:24.488Z" level=info msg="using Git version" pid=891 version=2.53.g1075gitlab # [ 10.457517] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="clearing disk cache object folder" pid=891 storage=default1076gitlab # [ 10.458200] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3919421819 pid=891 storage=default1077gitlab # [ 10.459084] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3919421819 pid=891 storage=default1078gitlab # [ 10.459746] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8911079gitlab # [ 10.460508] gitaly[891]: time="2026-10-06T14:46:24.489Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8911080gitlab # [ 10.461181] gitaly[891]: time="2026-10-06T14:46:24.490Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3919421819 clear_duration_ms=0 pid=891 storage=default1081gitlab # [ 10.497187] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8911082gitlab # [ 10.497910] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=info msg="counting repositories" pid=8911083gitlab # [ 10.498569] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="starting to count repositories" pid=891 storage_path=/var/gitlab/state/repositories1084gitlab # [ 10.499152] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=891 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.499785] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="completed counting all repositories" counting_duration=0 pid=8911086gitlab # [ 10.499988] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=891 schema=unix1087gitlab # [ 10.500543] gitaly[891]: time="2026-10-06T14:46:24.529Z" level=info msg="listening at address" address=/run/gitaly/gitaly-891/sock.d/intern pid=891 schema=unix1088gitlab # [ 10.500741] gitaly[891]: time="2026-10-06T14:46:24.531Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8911089gitlab # [ 10.501445] gitaly[891]: time="2026-10-06T14:46:24.531Z" level=info msg="Started Gitaly" duration_ms=254 pid=8911090gitlab # [ 10.502107] gitaly[891]: time="2026-10-06T14:46:24.531Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8911091gitlab # [ 10.516083] gitaly[891]: time="2026-10-06T14:46:24.528Z" level=info msg="finished tempdir cleaner walk" pid=891 storage=default time_ms=01092gitlab # [ 10.516859] gitaly[891]: time="2026-10-06T14:46:24.547Z" level=info msg="maintenance: daily scheduled" pid=891 scheduled="2026-10-07 12:00:00 +0000 UTC"1093gitlab # [ 11.402604] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1094gitlab # [ 11.406514] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1095gitlab # [ 11.434654] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1096gitlab # [ 12.488866] gitaly[891]: time="2026-10-06T14:46:26.519Z" level=info msg="License database preloaded" duration_ms=2242 pid=8911097gitlab # [ 12.775547] dhcpcd[762]: eth0: leased 10.0.2.15 for 86400 seconds1098gitlab # [ 12.775944] dhcpcd[762]: eth0: adding route to 10.0.2.0/241099gitlab # [ 12.776413] dhcpcd[762]: eth0: adding default route via 10.0.2.21100gitlab # [ 12.895188] systemd[1]: Started DHCP Client.1101gitlab # [ 12.895951] systemd[1]: Reached target Network is Online.1102gitlab # [ 43.520138] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[912]: W, [2026-10-06T14:46:57.551102 #912] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1103gitlab # [ 45.685934] postgres[1331]: [1331] ERROR: relation "feature_gates" does not exist at character 5231104gitlab # [ 45.687562] postgres[1331]: [1331] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1105gitlab # [ 45.687854] postgres[1331]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1106gitlab # [ 45.690105] postgres[1331]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1107gitlab # [ 45.691232] postgres[1331]: attidentity AS identity,1108gitlab # [ 45.692368] postgres[1331]: attgenerated as attgenerated1109gitlab # [ 45.693874] postgres[1331]: FROM pg_attribute a1110gitlab # [ 45.695371] postgres[1331]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1111gitlab # [ 45.696883] postgres[1331]: LEFT JOIN pg_type t ON a.atttypid = t.oid1112gitlab # [ 45.698371] postgres[1331]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1113gitlab # [ 45.699882] postgres[1331]: WHERE a.attrelid = '"feature_gates"'::regclass1114gitlab # [ 45.701405] postgres[1331]: AND a.attnum > 0 AND NOT a.attisdropped1115gitlab # [ 45.702988] postgres[1331]: ORDER BY a.attnum1116gitlab # [ 45.703746] postgres[1331]:1117gitlab # [ 48.582139] gitlab-workhorse[822]: time="2026-10-06T14:47:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 49.542405] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1364]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 49.544818] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1364]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 58.583577] gitlab-workhorse[822]: time="2026-10-06T14:47:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 65.311296] postgres[1439]: [1439] ERROR: relation "table_without_models" does not exist1122gitlab # [ 65.312578] postgres[1439]: [1439] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1123gitlab # [ 68.592305] gitlab-workhorse[822]: time="2026-10-06T14:47:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 77.724938] systemd[1]: Finished gitlab-db-config.service.1125gitlab # [ 77.731750] systemd[1]: Started gitlab-sidekiq.service.1126gitlab # [ 77.737419] systemd[1]: Starting gitlab.service...1127gitlab # [ 78.110898] bundle[1615]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1128gitlab # [ 78.112225] bundle[1615]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1129gitlab # [ 78.115934] bundle[1615]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1130gitlab # [ 78.602785] gitlab-workhorse[822]: time="2026-10-06T14:47:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1131gitlab # [ 80.981592] sidekiq-cluster[1614]: {"severity":"INFO","time":"2026-10-06T14:47:34.995Z","message":"Starting cluster with 1 processes"}1132gitlab # [ 81.094952] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.105Z","pid":1615,"message":"* Enabling systemd notification integration"}1133gitlab # [ 81.096068] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"Puma starting in cluster mode..."}1134gitlab # [ 81.096920] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1135gitlab # [ 81.097827] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1136gitlab # [ 81.098532] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Min threads: 0"}1137gitlab # [ 81.099518] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Max threads: 4"}1138gitlab # [ 81.100145] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Environment: production"}1139gitlab # [ 81.101059] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Master PID: 1615"}1140gitlab # [ 81.101754] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Workers: 2"}1141gitlab # [ 81.102472] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1142gitlab # [ 81.103216] bundle[1615]: {"timestamp":"2026-10-06T14:47:35.126Z","pid":1615,"message":"* Preloading application"}1143gitlab # [ 88.613074] gitlab-workhorse[822]: time="2026-10-06T14:47:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 98.623493] gitlab-workhorse[822]: time="2026-10-06T14:47:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 105.316656] bundle[1615]: W, [2026-10-06T14:47:59.347556 #1615] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 108.167575] sidekiq-cluster[1645]: 2026-10-06T14:48:02.198Z pid=1645 tid=wjp INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1645, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>438460416}1147gitlab # [ 108.347890] sidekiq-cluster[1645]: W, [2026-10-06T14:48:02.379480 #1645] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 108.388585] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:02.420Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1149gitlab # [ 108.633642] gitlab-workhorse[822]: time="2026-10-06T14:48:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1150gitlab # [ 110.582477] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.613Z","message":"GitLab reliable fetch activated!"}1151gitlab # [ 110.583798] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.613Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1152gitlab # [ 110.637737] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.669Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1153gitlab # [ 110.643443] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.675Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1154gitlab # [ 110.655945] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.687Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1155gitlab # [ 110.661200] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.693Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1156gitlab # [ 110.666418] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.698Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1157gitlab # [ 110.672109] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.703Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1158gitlab # [ 110.679351] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.711Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1159gitlab # [ 110.685092] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.716Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1160gitlab # [ 110.690834] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.722Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1161gitlab # [ 110.696671] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.728Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1162gitlab # [ 110.704804] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.736Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1163gitlab # [ 110.710147] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.741Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1164gitlab # [ 110.713847] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.745Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1165gitlab # [ 110.719350] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.751Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1166gitlab # [ 110.725364] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.757Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1167gitlab # [ 110.731651] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.763Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1168gitlab # [ 110.738899] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.770Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1169gitlab # [ 110.745584] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.777Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1170gitlab # [ 110.753167] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.784Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1171gitlab # [ 110.759864] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.791Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1172gitlab # [ 110.768321] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.799Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1173gitlab # [ 110.775556] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.807Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1174gitlab # [ 110.781826] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.813Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1175gitlab # [ 110.788923] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.820Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1176gitlab # [ 110.795111] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.826Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1177gitlab # [ 110.801902] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.833Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1178gitlab # [ 110.808634] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.840Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1179gitlab # [ 110.815357] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.847Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1180gitlab # [ 110.822312] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.854Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1181gitlab # [ 110.828519] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.860Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1182gitlab # [ 110.834184] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.865Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1183gitlab # [ 110.842490] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.874Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1184gitlab # [ 110.850315] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.882Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1185gitlab # [ 110.857266] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.889Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1186gitlab # [ 110.863723] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.895Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1187gitlab # [ 110.869602] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.901Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1188gitlab # [ 110.875289] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.907Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1189gitlab # [ 110.881659] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.913Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1190gitlab # [ 110.886701] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.918Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1191gitlab # [ 110.891600] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.923Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1192gitlab # [ 110.896957] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.928Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1193gitlab # [ 110.901934] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.933Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1194gitlab # [ 110.909703] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.941Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1195gitlab # [ 110.915729] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.947Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1196gitlab # [ 110.922485] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.954Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1197gitlab # [ 110.929049] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.960Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1198gitlab # [ 110.934644] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.966Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1199gitlab # [ 110.940723] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.972Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1200gitlab # [ 110.947392] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.979Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1201gitlab # [ 110.953371] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.985Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1202gitlab # [ 110.959577] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.991Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1203gitlab # [ 110.966365] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:04.998Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1204gitlab # [ 110.986221] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.017Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1205gitlab # [ 110.992872] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.024Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1206gitlab # [ 111.000585] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.032Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1207gitlab # [ 111.011099] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.042Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1208gitlab # [ 111.019424] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.051Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1209gitlab # [ 111.028622] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.060Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1210gitlab # [ 111.036111] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.067Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1211gitlab # [ 111.044615] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.076Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1212gitlab # [ 111.052486] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.084Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1213gitlab # [ 111.059757] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.091Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1214gitlab # [ 111.068488] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.100Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1215gitlab # [ 111.077447] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.109Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1216gitlab # [ 111.086095] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.117Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1217gitlab # [ 111.122265] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.152Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1218gitlab # [ 111.132637] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.164Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1219gitlab # [ 111.141662] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.173Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1220gitlab # [ 111.150919] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.182Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1221gitlab # [ 111.160197] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.191Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1222gitlab # [ 111.172169] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.203Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1223gitlab # [ 111.181122] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.212Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1224gitlab # [ 111.192151] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.223Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1225gitlab # [ 111.201808] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.233Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1226gitlab # [ 111.212219] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.243Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1227gitlab # [ 111.221347] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.253Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1228gitlab # [ 111.231797] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.263Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1229gitlab # [ 111.242237] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.273Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1230gitlab # [ 111.251686] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.283Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1231gitlab # [ 111.260337] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.292Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1232gitlab # [ 111.269425] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.301Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1233gitlab # [ 111.279698] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.311Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1234gitlab # [ 111.290340] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.322Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1235gitlab # [ 111.299421] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.331Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1236gitlab # [ 111.307907] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.339Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1237gitlab # [ 111.318545] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.350Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1238gitlab # [ 111.328055] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.359Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1239gitlab # [ 111.337247] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.368Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1240gitlab # [ 111.345449] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.377Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1241gitlab # [ 111.354667] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.386Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1242gitlab # [ 111.362291] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.394Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1243gitlab # [ 111.370226] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.401Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1244gitlab # [ 111.378795] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.410Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1245gitlab # [ 111.386760] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.418Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1246gitlab # [ 111.395743] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.427Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1247gitlab # [ 111.404729] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.436Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1248gitlab # [ 111.413112] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.444Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1249gitlab # [ 111.420906] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.452Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1250gitlab # [ 111.446309] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.478Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1251gitlab # [ 111.454543] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.486Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1252gitlab # [ 111.463072] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.494Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1253gitlab # [ 111.473909] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.505Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1254gitlab # [ 111.483942] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.515Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1255gitlab # [ 111.493496] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.525Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1256gitlab # [ 111.504087] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.535Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1257gitlab # [ 111.512788] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.544Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1258gitlab # [ 111.521485] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.552Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1259gitlab # [ 111.533514] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.565Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1260gitlab # [ 111.542107] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:05.573Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1261gitlab # [ 118.644163] gitlab-workhorse[822]: time="2026-10-06T14:48:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 128.645925] gitlab-workhorse[822]: time="2026-10-06T14:48:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 133.958960] postgres[2138]: [2138] ERROR: relation "table_without_models" does not exist1264gitlab # [ 133.959672] postgres[2138]: [2138] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 135.865830] postgres[2149]: [2149] ERROR: relation "table_without_models" does not exist1266gitlab # [ 135.866913] postgres[2149]: [2149] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 136.479137] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.510Z","message":"Booted Rails 7.2.3.1 application in production environment"}1268gitlab # [ 136.485072] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.516Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1269gitlab # [ 136.489175] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.516Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1270gitlab # [ 136.490974] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.516Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1271gitlab # [ 136.494165] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:30.519Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1272gitlab # [ 138.301405] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:32.332Z","message":"Cleaning working queues"}1273gitlab # [ 138.304594] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:32.335Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b3f2608f475fd7282adaf2c7","created_at":"2026-10-06T14:47:31.344Z","trace_propagation_headers":{"sentry-trace":"5469ca743a8d4ab5b550a30a3e9b5998-fed5049425114a62","baggage":"sentry-trace_id=5469ca743a8d4ab5b550a30a3e9b5998,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1fe1098dfe148eaf9c62b8f7fd86f7f2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:47:31.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b3f2608f475fd7282adaf2c7: start","job_status":"start","queue_duration_s":60.98304,"scheduling_latency_s":60.983111}1274gitlab # [ 138.497538] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:48:32.528Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b3f2608f475fd7282adaf2c7","created_at":"2026-10-06T14:47:31.344Z","trace_propagation_headers":{"sentry-trace":"5469ca743a8d4ab5b550a30a3e9b5998-fed5049425114a62","baggage":"sentry-trace_id=5469ca743a8d4ab5b550a30a3e9b5998,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"1fe1098dfe148eaf9c62b8f7fd86f7f2","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:47:31.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b3f2608f475fd7282adaf2c7: done: 0.192943 sec","job_status":"done","queue_duration_s":60.98304,"scheduling_latency_s":60.983111,"redis_calls":31,"redis_duration_s":0.008117,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004593,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002203,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.096561714,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.192943,"completed_at":"2026-10-06T14:48:32.528Z","load_balancing_strategy":"primary","db_duration_s":0.063579,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1275gitlab # [ 138.647253] gitlab-workhorse[822]: time="2026-10-06T14:48:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1276gitlab # [ 138.882913] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.913Z","pid":1615,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1277gitlab # [ 138.884454] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1278gitlab # [ 138.885947] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"! #\u003cThread:0x0000727c94e5d818 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1279gitlab # [ 138.887503] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"! #\u003cThread:0x0000727c9505c650 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1280gitlab # [ 138.888212] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"Use Ctrl-C to stop"}1281gitlab # [ 138.889336] bundle[1615]: {"timestamp":"2026-10-06T14:48:32.914Z","pid":1615,"message":"Sending status to systemd every 1.0 sec"}1282gitlab # [ 139.697663] bundle[1615]: {"timestamp":"2026-10-06T14:48:33.729Z","pid":1615,"message":"- Worker 0 (PID: 2212) booted in 0.75s, phase: 0"}1283gitlab # [ 139.723393] bundle[1615]: {"timestamp":"2026-10-06T14:48:33.755Z","pid":1615,"message":"- Worker 1 (PID: 2216) booted in 0.75s, phase: 0"}1284gitlab # [ 139.728294] systemd[1]: Started gitlab.service.1285gitlab # [ 139.729047] systemd[1]: Reached target Common target for all GitLab services..1286gitlab # [ 139.732742] systemd[1]: Starting setup-gitlab.service...1287gitlab # [ 139.751133] setup-gitlab-start[2249]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1288gitlab # [ 142.097988] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:48:36 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23141289gitlab # [ 142.104085] setup-gitlab-start[2249]: + TOKEN=nixbot-test-token-of-20-chars1290gitlab # [ 142.106612] setup-gitlab-start[2249]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1291gitlab # [ 142.120561] runuser[2267]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1292gitlab # [ 142.492494] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 142.494219] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 142.495331] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 143.081184] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1296gitlab # [ 143.083398] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1297gitlab # [ 143.085506] setup-gitlab-start[2268]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1298gitlab # [ 169.022198] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.052Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b0deafca26b3facf6bccbe37","created_at":"2026-10-06T14:49:02.971Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea439cfd6ff374cb6aa293af6d85172e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.049Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b0deafca26b3facf6bccbe37: start","job_status":"start","queue_duration_s":0.002742,"scheduling_latency_s":0.002801}1299gitlab # [ 169.151571] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b0deafca26b3facf6bccbe37","created_at":"2026-10-06T14:49:02.971Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea439cfd6ff374cb6aa293af6d85172e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.049Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b0deafca26b3facf6bccbe37: done: 0.130509 sec","job_status":"done","queue_duration_s":0.002742,"scheduling_latency_s":0.002801,"redis_calls":13,"redis_duration_s":0.013612,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.006126,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00385,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0129631,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.130509,"completed_at":"2026-10-06T14:49:03.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019023,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1300gitlab # [ 169.222085] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b942d42c78f6f426a6e4931","created_at":"2026-10-06T14:49:03.093Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"018e6eb878f2bd5c13c21cce122895bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-06T14:49:03.107Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b942d42c78f6f426a6e4931: start","job_status":"start","queue_duration_s":0.079591,"scheduling_latency_s":0.079607}1301gitlab # [ 169.234270] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.195Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1302gitlab # [ 169.237853] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3b942d42c78f6f426a6e4931","created_at":"2026-10-06T14:49:03.093Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"018e6eb878f2bd5c13c21cce122895bd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-06T14:49:03.107Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3b942d42c78f6f426a6e4931: done: 0.013251 sec","job_status":"done","queue_duration_s":0.079591,"scheduling_latency_s":0.079607,"redis_calls":10,"redis_duration_s":0.001905,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000404,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000386,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257854,"duration_s":0.013251,"completed_at":"2026-10-06T14:49:03.199Z","load_balancing_strategy":"primary","db_duration_s":0.000305,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 169.275877] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ea3dbe3c836f89d8107e065c","created_at":"2026-10-06T14:49:03.118Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"257e03ef0952352853eadd5ea6986a59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.127Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ea3dbe3c836f89d8107e065c: start","job_status":"start","queue_duration_s":0.073992,"scheduling_latency_s":0.074005}1304gitlab # [ 169.289557] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"ea3dbe3c836f89d8107e065c","created_at":"2026-10-06T14:49:03.118Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"257e03ef0952352853eadd5ea6986a59","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.127Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-ea3dbe3c836f89d8107e065c: done: 0.01372 sec","job_status":"done","queue_duration_s":0.073992,"scheduling_latency_s":0.074005,"redis_calls":12,"redis_duration_s":0.0027419999999999996,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00121,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000273498,"duration_s":0.01372,"completed_at":"2026-10-06T14:49:03.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000475,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 169.311320] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e555e9491133d58a98023c10","created_at":"2026-10-06T14:49:03.131Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f93e39dce67efa0292e30219209ef2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.139Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e555e9491133d58a98023c10: start","job_status":"start","queue_duration_s":0.077367,"scheduling_latency_s":0.077419}1306gitlab # [ 169.344150] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e555e9491133d58a98023c10","created_at":"2026-10-06T14:49:03.131Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f93e39dce67efa0292e30219209ef2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.139Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e555e9491133d58a98023c10: done: 0.158833 sec","job_status":"done","queue_duration_s":0.077367,"scheduling_latency_s":0.077419,"redis_calls":14,"redis_duration_s":0.004443,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000933,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001996,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047073,"exclusive_lock_hold_duration_s":0.109109398,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.158833,"completed_at":"2026-10-06T14:49:03.375Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.107901,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 169.394520] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.425Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6995c22d505b328c61c38949","created_at":"2026-10-06T14:49:03.149Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f50acb04f15a406f78b8d49d811831","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.167Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6995c22d505b328c61c38949: start","job_status":"start","queue_duration_s":0.25825,"scheduling_latency_s":0.258294}1308gitlab # [ 169.460561] setup-gitlab-start[2268]: W, [2026-10-06T14:49:03.491595 #2268] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1309gitlab # [ 169.499750] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.530Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6995c22d505b328c61c38949","created_at":"2026-10-06T14:49:03.149Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6f50acb04f15a406f78b8d49d811831","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.167Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6995c22d505b328c61c38949: done: 0.105058 sec","job_status":"done","queue_duration_s":0.25825,"scheduling_latency_s":0.258294,"redis_calls":16,"redis_duration_s":0.01685,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.004516,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001180597,"duration_s":0.105058,"completed_at":"2026-10-06T14:49:03.530Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 169.550251] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a31229a60dda065b889ce1fa","created_at":"2026-10-06T14:49:03.180Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80b5748d774b1bc1242eb23685e35ed1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-06T14:49:03.233Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a31229a60dda065b889ce1fa: start","job_status":"start","queue_duration_s":0.34774,"scheduling_latency_s":0.34779}1311gitlab # [ 169.619118] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a31229a60dda065b889ce1fa","created_at":"2026-10-06T14:49:03.180Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80b5748d774b1bc1242eb23685e35ed1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-06T14:49:03.233Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a31229a60dda065b889ce1fa: done: 0.06968 sec","job_status":"done","queue_duration_s":0.34774,"scheduling_latency_s":0.34779,"redis_calls":10,"redis_duration_s":0.006699999999999999,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001022,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002861,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000630527,"duration_s":0.06968,"completed_at":"2026-10-06T14:49:03.650Z","load_balancing_strategy":"primary","db_duration_s":0.012633,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 169.667732] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d40e3f476ea0e43e1c569630","created_at":"2026-10-06T14:49:03.238Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3510ac685b253d42b68459fbcd2b5f94","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.263Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d40e3f476ea0e43e1c569630: start","job_status":"start","queue_duration_s":0.435323,"scheduling_latency_s":0.435364}1313gitlab # [ 169.946853] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:03.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"d40e3f476ea0e43e1c569630","created_at":"2026-10-06T14:49:03.238Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3510ac685b253d42b68459fbcd2b5f94","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.263Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-d40e3f476ea0e43e1c569630: done: 0.279177 sec","job_status":"done","queue_duration_s":0.435323,"scheduling_latency_s":0.435364,"redis_calls":12,"redis_duration_s":0.004133,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000687,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.039,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001485943,"exclusive_lock_hold_duration_s":0.235044678,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.279177,"completed_at":"2026-10-06T14:49:03.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.064687,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 169.988422] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f2d476532d2f74461df0c398","created_at":"2026-10-06T14:49:03.268Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b83d4f9522fc6d0d1876af0e66bdf2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.280Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f2d476532d2f74461df0c398: start","job_status":"start","queue_duration_s":0.739139,"scheduling_latency_s":0.739167}1315gitlab # [ 170.034218] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f2d476532d2f74461df0c398","created_at":"2026-10-06T14:49:03.268Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b83d4f9522fc6d0d1876af0e66bdf2f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.280Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f2d476532d2f74461df0c398: done: 0.044778 sec","job_status":"done","queue_duration_s":0.739139,"scheduling_latency_s":0.739167,"redis_calls":10,"redis_duration_s":0.002916,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00053,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000510959,"duration_s":0.044778,"completed_at":"2026-10-06T14:49:04.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000789,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 170.075479] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1c2325ebcfe5d5ac6e084897","created_at":"2026-10-06T14:49:03.286Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30e83f33d9223af5b4c7be74666d5794","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.289Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1c2325ebcfe5d5ac6e084897: start","job_status":"start","queue_duration_s":0.816715,"scheduling_latency_s":0.81677}1317gitlab # [ 170.095438] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.127Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1318gitlab # [ 170.106779] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1c2325ebcfe5d5ac6e084897","created_at":"2026-10-06T14:49:03.286Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30e83f33d9223af5b4c7be74666d5794","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.289Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1c2325ebcfe5d5ac6e084897: done: 0.03145 sec","job_status":"done","queue_duration_s":0.816715,"scheduling_latency_s":0.81677,"redis_calls":10,"redis_duration_s":0.003273,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000741,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001875,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000552026,"duration_s":0.03145,"completed_at":"2026-10-06T14:49:04.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 170.147143] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.178Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"45e728fd813898b36e946e61","created_at":"2026-10-06T14:49:03.295Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.298Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-45e728fd813898b36e946e61: start","job_status":"start","queue_duration_s":0.879705,"scheduling_latency_s":0.879764}1320gitlab # [ 170.213191] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"45e728fd813898b36e946e61","created_at":"2026-10-06T14:49:03.295Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.298Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-45e728fd813898b36e946e61: done: 0.066282 sec","job_status":"done","queue_duration_s":0.879705,"scheduling_latency_s":0.879764,"redis_calls":19,"redis_duration_s":0.004238,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001071,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000294,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002214,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000379657,"duration_s":0.066282,"completed_at":"2026-10-06T14:49:04.244Z","load_balancing_strategy":"primary","db_duration_s":0.003544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 170.262935] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6b8bfe74050b2eccfb68d29","created_at":"2026-10-06T14:49:03.300Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045ae53eb6ef0b7db2963d46c031c55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.303Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6b8bfe74050b2eccfb68d29: start","job_status":"start","queue_duration_s":0.990382,"scheduling_latency_s":0.990436}1322gitlab # [ 170.326589] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.357Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"d6b8bfe74050b2eccfb68d29","created_at":"2026-10-06T14:49:03.300Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"045ae53eb6ef0b7db2963d46c031c55b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.303Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-d6b8bfe74050b2eccfb68d29: done: 0.063658 sec","job_status":"done","queue_duration_s":0.990382,"scheduling_latency_s":0.990436,"redis_calls":12,"redis_duration_s":0.004998,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00102527,"exclusive_lock_hold_duration_s":0.019872079,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.063658,"completed_at":"2026-10-06T14:49:04.357Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 170.330731] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"95a24a927a56781cedb6bd85","created_at":"2026-10-06T14:49:03.311Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa899f8a7f3e923f869d9f8fbab7b94b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.315Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-95a24a927a56781cedb6bd85: start","job_status":"start","queue_duration_s":1.046605,"scheduling_latency_s":1.046639}1324gitlab # [ 170.385904] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"95a24a927a56781cedb6bd85","created_at":"2026-10-06T14:49:03.311Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa899f8a7f3e923f869d9f8fbab7b94b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.315Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-95a24a927a56781cedb6bd85: done: 0.034613 sec","job_status":"done","queue_duration_s":1.046605,"scheduling_latency_s":1.046639,"redis_calls":12,"redis_duration_s":0.003862,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001829,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001414,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000686679,"exclusive_lock_hold_duration_s":0.008536279999999999,"duration_s":0.034613,"completed_at":"2026-10-06T14:49:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.004316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 170.392310] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1f394d1ccf1218ee6868ab15","created_at":"2026-10-06T14:49:03.323Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c99f1dce2bcbf9805322882d051edaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.329Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1f394d1ccf1218ee6868ab15: start","job_status":"start","queue_duration_s":1.069181,"scheduling_latency_s":1.069207}1326gitlab # [ 170.437282] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.408Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1327gitlab # [ 170.438237] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.412Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1f394d1ccf1218ee6868ab15","created_at":"2026-10-06T14:49:03.323Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6c99f1dce2bcbf9805322882d051edaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.329Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1f394d1ccf1218ee6868ab15: done: 0.014137 sec","job_status":"done","queue_duration_s":1.069181,"scheduling_latency_s":1.069207,"redis_calls":10,"redis_duration_s":0.002176,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000330768,"duration_s":0.014137,"completed_at":"2026-10-06T14:49:04.412Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 170.448833] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.414Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e533a276dbd7e3190cdf5893","created_at":"2026-10-06T14:49:03.337Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.344Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e533a276dbd7e3190cdf5893: start","job_status":"start","queue_duration_s":1.069431,"scheduling_latency_s":1.069446}1329gitlab # [ 170.499141] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"e533a276dbd7e3190cdf5893","created_at":"2026-10-06T14:49:03.337Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.344Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-e533a276dbd7e3190cdf5893: done: 0.083346 sec","job_status":"done","queue_duration_s":1.069431,"scheduling_latency_s":1.069446,"redis_calls":71,"redis_duration_s":0.027752,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003684,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000997,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.019209,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003862,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000278528,"duration_s":0.083346,"completed_at":"2026-10-06T14:49:04.497Z","load_balancing_strategy":"primary","db_duration_s":0.002492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 170.500619] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.498Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"17e3c240ef4077f7a9fd63d7","created_at":"2026-10-06T14:49:03.346Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbffe826ce138c88ffe53dfb34784dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-17e3c240ef4077f7a9fd63d7: start","job_status":"start","queue_duration_s":1.14617,"scheduling_latency_s":1.146184}1331gitlab # [ 170.571610] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"17e3c240ef4077f7a9fd63d7","created_at":"2026-10-06T14:49:03.346Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6dbffe826ce138c88ffe53dfb34784dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.352Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-17e3c240ef4077f7a9fd63d7: done: 0.104437 sec","job_status":"done","queue_duration_s":1.14617,"scheduling_latency_s":1.146184,"redis_calls":12,"redis_duration_s":0.0031609999999999997,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000436368,"exclusive_lock_hold_duration_s":0.08860734999999999,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.104437,"completed_at":"2026-10-06T14:49:04.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016118,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1332gitlab # [ 170.574633] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e9117d98214d622d7ef2c91d","created_at":"2026-10-06T14:49:03.355Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b54b9ed76a744ea46785e7b491511de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.361Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e9117d98214d622d7ef2c91d: start","job_status":"start","queue_duration_s":1.245126,"scheduling_latency_s":1.245152}1333gitlab # [ 170.622327] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.619Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1334gitlab # [ 170.623213] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e9117d98214d622d7ef2c91d","created_at":"2026-10-06T14:49:03.355Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b54b9ed76a744ea46785e7b491511de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.361Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e9117d98214d622d7ef2c91d: done: 0.018223 sec","job_status":"done","queue_duration_s":1.245126,"scheduling_latency_s":1.245152,"redis_calls":10,"redis_duration_s":0.0037340000000000003,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001891,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000304508,"duration_s":0.018223,"completed_at":"2026-10-06T14:49:04.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 170.665543] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ae42debd81951f58d85ee843","created_at":"2026-10-06T14:49:03.423Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0989d64f1288447e6b8ba4b11c32603c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.444Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ae42debd81951f58d85ee843: start","job_status":"start","queue_duration_s":1.180933,"scheduling_latency_s":1.180947}1336gitlab # [ 170.666602] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ae42debd81951f58d85ee843","created_at":"2026-10-06T14:49:03.423Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0989d64f1288447e6b8ba4b11c32603c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.444Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ae42debd81951f58d85ee843: done: 0.035162 sec","job_status":"done","queue_duration_s":1.180933,"scheduling_latency_s":1.180947,"redis_calls":10,"redis_duration_s":0.004746,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00052,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000309257,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.035162,"completed_at":"2026-10-06T14:49:04.660Z","load_balancing_strategy":"primary","db_duration_s":0.017825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 170.719857] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"52f62c0c62fd8168bcd20972","created_at":"2026-10-06T14:49:03.461Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"319b0bfcfd2d9918dbf73dba7b23849a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.471Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-52f62c0c62fd8168bcd20972: start","job_status":"start","queue_duration_s":1.190465,"scheduling_latency_s":1.190479}1338gitlab # [ 170.878889] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"52f62c0c62fd8168bcd20972","created_at":"2026-10-06T14:49:03.461Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"319b0bfcfd2d9918dbf73dba7b23849a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.471Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-52f62c0c62fd8168bcd20972: done: 0.247975 sec","job_status":"done","queue_duration_s":1.190465,"scheduling_latency_s":1.190479,"redis_calls":565,"redis_duration_s":0.087972,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000442,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.086211,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.182953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000341943,"duration_s":0.247975,"completed_at":"2026-10-06T14:49:04.910Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 170.937185] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:04.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"293346f3345e215d5e906833","created_at":"2026-10-06T14:49:03.478Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7a07dcbbf48f2c13e31a8596ef98c06","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.483Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-293346f3345e215d5e906833: start","job_status":"start","queue_duration_s":1.485058,"scheduling_latency_s":1.48509}1340gitlab # [ 170.969563] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"293346f3345e215d5e906833","created_at":"2026-10-06T14:49:03.478Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7a07dcbbf48f2c13e31a8596ef98c06","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.483Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-293346f3345e215d5e906833: done: 0.0327 sec","job_status":"done","queue_duration_s":1.485058,"scheduling_latency_s":1.48509,"redis_calls":10,"redis_duration_s":0.00151,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000223492,"duration_s":0.0327,"completed_at":"2026-10-06T14:49:05.001Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 171.009230] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"14f971478dac8a47cbc9f218","created_at":"2026-10-06T14:49:03.489Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9271306ebbed3aee312fab41edefa6b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-06T14:49:03.495Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-14f971478dac8a47cbc9f218: start","job_status":"start","queue_duration_s":1.545457,"scheduling_latency_s":1.545483}1342gitlab # [ 171.034832] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.065Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1343gitlab # [ 171.043706] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"14f971478dac8a47cbc9f218","created_at":"2026-10-06T14:49:03.489Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9271306ebbed3aee312fab41edefa6b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-06T14:49:03.495Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-14f971478dac8a47cbc9f218: done: 0.034115 sec","job_status":"done","queue_duration_s":1.545457,"scheduling_latency_s":1.545483,"redis_calls":10,"redis_duration_s":0.002813,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000460393,"duration_s":0.034115,"completed_at":"2026-10-06T14:49:05.074Z","load_balancing_strategy":"primary","db_duration_s":0.000847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 171.045503] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6af4767f1870dbac6895982a","created_at":"2026-10-06T14:49:03.506Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7154b0d76b289bb809fbcdf10a96039d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.514Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6af4767f1870dbac6895982a: start","job_status":"start","queue_duration_s":1.562368,"scheduling_latency_s":1.562394}1345gitlab # [ 171.055463] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.085Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1346gitlab # [ 171.097401] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6af4767f1870dbac6895982a","created_at":"2026-10-06T14:49:03.506Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7154b0d76b289bb809fbcdf10a96039d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.514Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6af4767f1870dbac6895982a: done: 0.013394 sec","job_status":"done","queue_duration_s":1.562368,"scheduling_latency_s":1.562394,"redis_calls":10,"redis_duration_s":0.001341,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244724,"duration_s":0.013394,"completed_at":"2026-10-06T14:49:05.090Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00091,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 171.098948] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.091Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c63fe226415e690a613d2d5","created_at":"2026-10-06T14:49:03.531Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b166ccea757636346055aca8688d1d4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.602Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c63fe226415e690a613d2d5: start","job_status":"start","queue_duration_s":1.489036,"scheduling_latency_s":1.48905}1348gitlab # [ 171.142487] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7c63fe226415e690a613d2d5","created_at":"2026-10-06T14:49:03.531Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-104622b6295d489d","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b166ccea757636346055aca8688d1d4","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:03.602Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7c63fe226415e690a613d2d5: done: 0.014299 sec","job_status":"done","queue_duration_s":1.489036,"scheduling_latency_s":1.48905,"redis_calls":12,"redis_duration_s":0.0017330000000000002,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000376863,"exclusive_lock_hold_duration_s":0.002842261,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.014299,"completed_at":"2026-10-06T14:49:05.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001892,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 171.152108] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.106Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52fe32981f5d927c608ba329","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52fe32981f5d927c608ba329: start","job_status":"start","queue_duration_s":0.867214,"scheduling_latency_s":0.867238}1350gitlab # [ 171.164802] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.116Z","message":"No existing merge request to be cleaned up."}1351gitlab # [ 171.166690] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.125Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"52fe32981f5d927c608ba329","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-52fe32981f5d927c608ba329: done: 0.019269 sec","job_status":"done","queue_duration_s":0.867214,"scheduling_latency_s":0.867238,"redis_calls":13,"redis_duration_s":0.001937,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00068,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254781,"duration_s":0.019269,"completed_at":"2026-10-06T14:49:05.125Z","load_balancing_strategy":"primary","db_duration_s":0.00386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 171.214766] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.126Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bcfbbcec2746022abc2caaa7","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bcfbbcec2746022abc2caaa7: start","job_status":"start","queue_duration_s":0.887461,"scheduling_latency_s":0.887475}1353gitlab # [ 171.215885] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.135Z","message":"No existing merge request to be cleaned up."}1354gitlab # [ 171.260134] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.140Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bcfbbcec2746022abc2caaa7","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bcfbbcec2746022abc2caaa7: done: 0.013516 sec","job_status":"done","queue_duration_s":0.887461,"scheduling_latency_s":0.887475,"redis_calls":10,"redis_duration_s":0.0013770000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013516,"completed_at":"2026-10-06T14:49:05.140Z","load_balancing_strategy":"primary","db_duration_s":0.004623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 171.261742] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.141Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ca1139133ecc0f9ca1051fa","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ca1139133ecc0f9ca1051fa: start","job_status":"start","queue_duration_s":0.901895,"scheduling_latency_s":0.901909}1356gitlab # [ 171.267846] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.147Z","message":"No existing merge request to be cleaned up."}1357gitlab # [ 171.269771] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.152Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ca1139133ecc0f9ca1051fa","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ca1139133ecc0f9ca1051fa: done: 0.011838 sec","job_status":"done","queue_duration_s":0.901895,"scheduling_latency_s":0.901909,"redis_calls":10,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000819,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011838,"completed_at":"2026-10-06T14:49:05.152Z","load_balancing_strategy":"primary","db_duration_s":0.001693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 171.313775] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.153Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1604e69eb951d31c2c9b0c2","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1604e69eb951d31c2c9b0c2: start","job_status":"start","queue_duration_s":0.914663,"scheduling_latency_s":0.914676}1359gitlab # [ 171.316638] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.160Z","message":"No existing merge request to be cleaned up."}1360gitlab # [ 171.319133] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.165Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b1604e69eb951d31c2c9b0c2","created_at":"2026-10-06T14:49:04.212Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-eccefc0d8dec4ac7","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d69b47c002acf8582c0a5082348f32a2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.239Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b1604e69eb951d31c2c9b0c2: done: 0.011794 sec","job_status":"done","queue_duration_s":0.914663,"scheduling_latency_s":0.914676,"redis_calls":10,"redis_duration_s":0.001441,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011794,"completed_at":"2026-10-06T14:49:05.165Z","load_balancing_strategy":"primary","db_duration_s":0.001676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 171.374823] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6013b7788624eb766b8676d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6013b7788624eb766b8676d8: start","job_status":"start","queue_duration_s":0.676214,"scheduling_latency_s":0.676227}1362gitlab # [ 171.376205] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6013b7788624eb766b8676d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6013b7788624eb766b8676d8: done: 0.014074 sec","job_status":"done","queue_duration_s":0.676214,"scheduling_latency_s":0.676227,"redis_calls":16,"redis_duration_s":0.0023,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001396,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216787,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-10-06T14:49:05.180Z","load_balancing_strategy":"primary","db_duration_s":0.000504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 171.419507] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51ff05ccc45f7b8ef632a9f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51ff05ccc45f7b8ef632a9f: start","job_status":"start","queue_duration_s":0.691191,"scheduling_latency_s":0.691204}1364gitlab # [ 171.421196] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b51ff05ccc45f7b8ef632a9f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b51ff05ccc45f7b8ef632a9f: done: 0.009403 sec","job_status":"done","queue_duration_s":0.691191,"scheduling_latency_s":0.691204,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009403,"completed_at":"2026-10-06T14:49:05.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 171.462817] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4495d33eae0c7baa605c55b7","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4495d33eae0c7baa605c55b7: start","job_status":"start","queue_duration_s":0.70149,"scheduling_latency_s":0.701503}1366gitlab # [ 171.463796] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4495d33eae0c7baa605c55b7","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4495d33eae0c7baa605c55b7: done: 0.009401 sec","job_status":"done","queue_duration_s":0.70149,"scheduling_latency_s":0.701503,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009401,"completed_at":"2026-10-06T14:49:05.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 171.509705] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"333a7e25086d54037de8e1d6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-333a7e25086d54037de8e1d6: start","job_status":"start","queue_duration_s":0.711776,"scheduling_latency_s":0.711792}1368gitlab # [ 171.510491] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"333a7e25086d54037de8e1d6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-333a7e25086d54037de8e1d6: done: 0.009372 sec","job_status":"done","queue_duration_s":0.711776,"scheduling_latency_s":0.711792,"redis_calls":13,"redis_duration_s":0.001702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009372,"completed_at":"2026-10-06T14:49:05.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 171.565539] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b787648b7b026526287e2294","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b787648b7b026526287e2294: start","job_status":"start","queue_duration_s":0.722026,"scheduling_latency_s":0.722041}1370gitlab # [ 171.566301] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b787648b7b026526287e2294","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b787648b7b026526287e2294: done: 0.009356 sec","job_status":"done","queue_duration_s":0.722026,"scheduling_latency_s":0.722041,"redis_calls":13,"redis_duration_s":0.001634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009356,"completed_at":"2026-10-06T14:49:05.221Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 171.610188] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af1f6d21f68d471bd88bb9b6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af1f6d21f68d471bd88bb9b6: start","job_status":"start","queue_duration_s":0.732276,"scheduling_latency_s":0.73229}1372gitlab # [ 171.610973] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af1f6d21f68d471bd88bb9b6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af1f6d21f68d471bd88bb9b6: done: 0.009255 sec","job_status":"done","queue_duration_s":0.732276,"scheduling_latency_s":0.73229,"redis_calls":13,"redis_duration_s":0.001664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009255,"completed_at":"2026-10-06T14:49:05.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 171.636752] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18644715ef2bfb8ccd02dd47","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18644715ef2bfb8ccd02dd47: start","job_status":"start","queue_duration_s":0.742513,"scheduling_latency_s":0.742527}1374gitlab # [ 171.686810] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18644715ef2bfb8ccd02dd47","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18644715ef2bfb8ccd02dd47: done: 0.009337 sec","job_status":"done","queue_duration_s":0.742513,"scheduling_latency_s":0.742527,"redis_calls":13,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009337,"completed_at":"2026-10-06T14:49:05.242Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 171.688113] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8758b324baec3a999677d37","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8758b324baec3a999677d37: start","job_status":"start","queue_duration_s":0.752727,"scheduling_latency_s":0.752741}1376gitlab # [ 171.695483] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8758b324baec3a999677d37","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8758b324baec3a999677d37: done: 0.009383 sec","job_status":"done","queue_duration_s":0.752727,"scheduling_latency_s":0.752741,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009383,"completed_at":"2026-10-06T14:49:05.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 171.739261] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa2b5d23cf694c72a0d15ca","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa2b5d23cf694c72a0d15ca: start","job_status":"start","queue_duration_s":0.763011,"scheduling_latency_s":0.763024}1378gitlab # [ 171.779914] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa2b5d23cf694c72a0d15ca","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa2b5d23cf694c72a0d15ca: done: 0.009301 sec","job_status":"done","queue_duration_s":0.763011,"scheduling_latency_s":0.763024,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009301,"completed_at":"2026-10-06T14:49:05.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 171.781043] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f4a376a74d6d851f8014d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f4a376a74d6d851f8014d8: start","job_status":"start","queue_duration_s":0.773202,"scheduling_latency_s":0.773217}1380gitlab # [ 171.830664] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8f4a376a74d6d851f8014d8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8f4a376a74d6d851f8014d8: done: 0.009569 sec","job_status":"done","queue_duration_s":0.773202,"scheduling_latency_s":0.773217,"redis_calls":13,"redis_duration_s":0.001886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001345,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009569,"completed_at":"2026-10-06T14:49:05.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 171.851826] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6893798cb4a879122537ac","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6893798cb4a879122537ac: start","job_status":"start","queue_duration_s":0.783618,"scheduling_latency_s":0.783631}1382gitlab # [ 171.852683] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec6893798cb4a879122537ac","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec6893798cb4a879122537ac: done: 0.009279 sec","job_status":"done","queue_duration_s":0.783618,"scheduling_latency_s":0.783631,"redis_calls":13,"redis_duration_s":0.0016250000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009279,"completed_at":"2026-10-06T14:49:05.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 171.873104] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"921648c2bf8fbbecbce14d23","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-921648c2bf8fbbecbce14d23: start","job_status":"start","queue_duration_s":0.793787,"scheduling_latency_s":0.793801}1384gitlab # [ 171.884866] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"921648c2bf8fbbecbce14d23","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-921648c2bf8fbbecbce14d23: done: 0.009317 sec","job_status":"done","queue_duration_s":0.793787,"scheduling_latency_s":0.793801,"redis_calls":13,"redis_duration_s":0.0016090000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009317,"completed_at":"2026-10-06T14:49:05.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 171.941097] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43939c182849d734dba8350c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43939c182849d734dba8350c: start","job_status":"start","queue_duration_s":0.804002,"scheduling_latency_s":0.804017}1386gitlab # [ 171.941913] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43939c182849d734dba8350c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43939c182849d734dba8350c: done: 0.009387 sec","job_status":"done","queue_duration_s":0.804002,"scheduling_latency_s":0.804017,"redis_calls":13,"redis_duration_s":0.001728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009387,"completed_at":"2026-10-06T14:49:05.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 171.981501] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8500a3d0ef906551806ffd0","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8500a3d0ef906551806ffd0: start","job_status":"start","queue_duration_s":0.814249,"scheduling_latency_s":0.814262}1388gitlab # [ 171.982247] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8500a3d0ef906551806ffd0","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8500a3d0ef906551806ffd0: done: 0.018942 sec","job_status":"done","queue_duration_s":0.814249,"scheduling_latency_s":0.814262,"redis_calls":13,"redis_duration_s":0.0026290000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018942,"completed_at":"2026-10-06T14:49:05.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 172.024748] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1089537b7880015b53f0e3db","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1089537b7880015b53f0e3db: start","job_status":"start","queue_duration_s":0.834924,"scheduling_latency_s":0.834957}1390gitlab # [ 172.025886] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1089537b7880015b53f0e3db","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1089537b7880015b53f0e3db: done: 0.011963 sec","job_status":"done","queue_duration_s":0.834924,"scheduling_latency_s":0.834957,"redis_calls":13,"redis_duration_s":0.001705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011963,"completed_at":"2026-10-06T14:49:05.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 172.068179] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52a95941fff54bc612c0dd8c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52a95941fff54bc612c0dd8c: start","job_status":"start","queue_duration_s":0.847687,"scheduling_latency_s":0.847724}1392gitlab # [ 172.072227] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52a95941fff54bc612c0dd8c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52a95941fff54bc612c0dd8c: done: 0.012174 sec","job_status":"done","queue_duration_s":0.847687,"scheduling_latency_s":0.847724,"redis_calls":13,"redis_duration_s":0.004482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012174,"completed_at":"2026-10-06T14:49:05.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 172.117635] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acbf604b27d7d49eb03f8792","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acbf604b27d7d49eb03f8792: start","job_status":"start","queue_duration_s":0.864881,"scheduling_latency_s":0.864896}1394gitlab # [ 172.118507] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acbf604b27d7d49eb03f8792","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acbf604b27d7d49eb03f8792: done: 0.014557 sec","job_status":"done","queue_duration_s":0.864881,"scheduling_latency_s":0.864896,"redis_calls":13,"redis_duration_s":0.0057669999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004266,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014557,"completed_at":"2026-10-06T14:49:05.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 172.160126] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1802ca6b6b9e408c54ea6e4","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1802ca6b6b9e408c54ea6e4: start","job_status":"start","queue_duration_s":0.880666,"scheduling_latency_s":0.880681}1396gitlab # [ 172.163951] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1802ca6b6b9e408c54ea6e4","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1802ca6b6b9e408c54ea6e4: done: 0.009903 sec","job_status":"done","queue_duration_s":0.880666,"scheduling_latency_s":0.880681,"redis_calls":13,"redis_duration_s":0.002386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009903,"completed_at":"2026-10-06T14:49:05.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 172.209161] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9b93de655131fc0be49298e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9b93de655131fc0be49298e: start","job_status":"start","queue_duration_s":0.891584,"scheduling_latency_s":0.891598}1398gitlab # [ 172.210585] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9b93de655131fc0be49298e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9b93de655131fc0be49298e: done: 0.009717 sec","job_status":"done","queue_duration_s":0.891584,"scheduling_latency_s":0.891598,"redis_calls":13,"redis_duration_s":0.0022570000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009717,"completed_at":"2026-10-06T14:49:05.391Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 172.251542] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.392Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36073d04aef4674df001620d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36073d04aef4674df001620d: start","job_status":"start","queue_duration_s":0.902359,"scheduling_latency_s":0.902372}1400gitlab # [ 172.290288] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36073d04aef4674df001620d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36073d04aef4674df001620d: done: 0.009772 sec","job_status":"done","queue_duration_s":0.902359,"scheduling_latency_s":0.902372,"redis_calls":13,"redis_duration_s":0.002252,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001482,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009772,"completed_at":"2026-10-06T14:49:05.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 172.291406] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de142f8e24ae55138ebb7585","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de142f8e24ae55138ebb7585: start","job_status":"start","queue_duration_s":0.913149,"scheduling_latency_s":0.913162}1402gitlab # [ 172.302534] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de142f8e24ae55138ebb7585","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de142f8e24ae55138ebb7585: done: 0.012357 sec","job_status":"done","queue_duration_s":0.913149,"scheduling_latency_s":0.913162,"redis_calls":13,"redis_duration_s":0.004704,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012357,"completed_at":"2026-10-06T14:49:05.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 172.349648] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd91dab72ec5abeb8dbc3c6c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd91dab72ec5abeb8dbc3c6c: start","job_status":"start","queue_duration_s":0.92688,"scheduling_latency_s":0.926893}1404gitlab # [ 172.350668] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd91dab72ec5abeb8dbc3c6c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd91dab72ec5abeb8dbc3c6c: done: 0.009873 sec","job_status":"done","queue_duration_s":0.92688,"scheduling_latency_s":0.926893,"redis_calls":13,"redis_duration_s":0.002281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001542,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009873,"completed_at":"2026-10-06T14:49:05.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 172.390534] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8217425a022af0f2cf5c193e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8217425a022af0f2cf5c193e: start","job_status":"start","queue_duration_s":0.937778,"scheduling_latency_s":0.937791}1406gitlab # [ 172.394601] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8217425a022af0f2cf5c193e","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8217425a022af0f2cf5c193e: done: 0.010036 sec","job_status":"done","queue_duration_s":0.937778,"scheduling_latency_s":0.937791,"redis_calls":13,"redis_duration_s":0.002476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010036,"completed_at":"2026-10-06T14:49:05.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 172.453649] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea93cb4d518599a60b41a371","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea93cb4d518599a60b41a371: start","job_status":"start","queue_duration_s":0.949196,"scheduling_latency_s":0.949209}1408gitlab # [ 172.454297] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea93cb4d518599a60b41a371","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea93cb4d518599a60b41a371: done: 0.010617 sec","job_status":"done","queue_duration_s":0.949196,"scheduling_latency_s":0.949209,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010617,"completed_at":"2026-10-06T14:49:05.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 172.477170] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.453Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5c83d5905f9f8d5c4d08f32","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5c83d5905f9f8d5c4d08f32: start","job_status":"start","queue_duration_s":0.96267,"scheduling_latency_s":0.962683}1410gitlab # [ 172.488726] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5c83d5905f9f8d5c4d08f32","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5c83d5905f9f8d5c4d08f32: done: 0.01099 sec","job_status":"done","queue_duration_s":0.96267,"scheduling_latency_s":0.962683,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01099,"completed_at":"2026-10-06T14:49:05.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 172.533727] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45bdcd21cdc215b345a3e03d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45bdcd21cdc215b345a3e03d: start","job_status":"start","queue_duration_s":0.974763,"scheduling_latency_s":0.974778}1412gitlab # [ 172.534747] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45bdcd21cdc215b345a3e03d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45bdcd21cdc215b345a3e03d: done: 0.011238 sec","job_status":"done","queue_duration_s":0.974763,"scheduling_latency_s":0.974778,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002323,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011238,"completed_at":"2026-10-06T14:49:05.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 172.583703] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c3d122e7dfaf60cbee33512","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c3d122e7dfaf60cbee33512: start","job_status":"start","queue_duration_s":0.987123,"scheduling_latency_s":0.987136}1414gitlab # [ 172.584430] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c3d122e7dfaf60cbee33512","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c3d122e7dfaf60cbee33512: done: 0.010872 sec","job_status":"done","queue_duration_s":0.987123,"scheduling_latency_s":0.987136,"redis_calls":13,"redis_duration_s":0.0026249999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010872,"completed_at":"2026-10-06T14:49:05.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 172.629080] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cc22807456a2fffdb05eb39","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cc22807456a2fffdb05eb39: start","job_status":"start","queue_duration_s":0.999107,"scheduling_latency_s":0.999121}1416gitlab # [ 172.629773] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cc22807456a2fffdb05eb39","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cc22807456a2fffdb05eb39: done: 0.0165 sec","job_status":"done","queue_duration_s":0.999107,"scheduling_latency_s":0.999121,"redis_calls":13,"redis_duration_s":0.007986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00337,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0165,"completed_at":"2026-10-06T14:49:05.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 172.673779] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14c6841dc1fa1b3662b5bf4f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14c6841dc1fa1b3662b5bf4f: start","job_status":"start","queue_duration_s":1.016753,"scheduling_latency_s":1.016766}1418gitlab # [ 172.674535] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14c6841dc1fa1b3662b5bf4f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14c6841dc1fa1b3662b5bf4f: done: 0.086288 sec","job_status":"done","queue_duration_s":1.016753,"scheduling_latency_s":1.016766,"redis_calls":13,"redis_duration_s":0.075604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.074644,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.086288,"completed_at":"2026-10-06T14:49:05.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 172.709690] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5debd2fd2a7da38acd9f5d80","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5debd2fd2a7da38acd9f5d80: start","job_status":"start","queue_duration_s":1.104767,"scheduling_latency_s":1.104789}1420gitlab # [ 172.721128] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5debd2fd2a7da38acd9f5d80","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5debd2fd2a7da38acd9f5d80: done: 0.083381 sec","job_status":"done","queue_duration_s":1.104767,"scheduling_latency_s":1.104789,"redis_calls":13,"redis_duration_s":0.070855,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.068582,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.083381,"completed_at":"2026-10-06T14:49:05.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 172.764635] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e257fab35e4fde112a7bbe5c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e257fab35e4fde112a7bbe5c: start","job_status":"start","queue_duration_s":1.190128,"scheduling_latency_s":1.19015}1422gitlab # [ 172.767207] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e257fab35e4fde112a7bbe5c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e257fab35e4fde112a7bbe5c: done: 0.010786 sec","job_status":"done","queue_duration_s":1.190128,"scheduling_latency_s":1.19015,"redis_calls":13,"redis_duration_s":0.001929,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010786,"completed_at":"2026-10-06T14:49:05.691Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 172.809324] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828f7ce19cc6bc50d16af6a5","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828f7ce19cc6bc50d16af6a5: start","job_status":"start","queue_duration_s":1.201888,"scheduling_latency_s":1.201902}1424gitlab # [ 172.812916] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828f7ce19cc6bc50d16af6a5","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828f7ce19cc6bc50d16af6a5: done: 0.009486 sec","job_status":"done","queue_duration_s":1.201888,"scheduling_latency_s":1.201902,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009486,"completed_at":"2026-10-06T14:49:05.701Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 172.859616] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cbe0d9e1f6ae006874e50ab","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cbe0d9e1f6ae006874e50ab: start","job_status":"start","queue_duration_s":1.212376,"scheduling_latency_s":1.212389}1426gitlab # [ 172.860487] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cbe0d9e1f6ae006874e50ab","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cbe0d9e1f6ae006874e50ab: done: 0.009471 sec","job_status":"done","queue_duration_s":1.212376,"scheduling_latency_s":1.212389,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009471,"completed_at":"2026-10-06T14:49:05.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 172.913073] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ed0704d7d50f914ee247ecf","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ed0704d7d50f914ee247ecf: start","job_status":"start","queue_duration_s":1.222866,"scheduling_latency_s":1.222882}1428gitlab # [ 172.913709] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ed0704d7d50f914ee247ecf","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ed0704d7d50f914ee247ecf: done: 0.01937 sec","job_status":"done","queue_duration_s":1.222866,"scheduling_latency_s":1.222882,"redis_calls":13,"redis_duration_s":0.011112,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01937,"completed_at":"2026-10-06T14:49:05.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 172.956166] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6220794733953173867473","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6220794733953173867473: start","job_status":"start","queue_duration_s":1.243152,"scheduling_latency_s":1.243166}1430gitlab # [ 172.956887] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e6220794733953173867473","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e6220794733953173867473: done: 0.009764 sec","job_status":"done","queue_duration_s":1.243152,"scheduling_latency_s":1.243166,"redis_calls":13,"redis_duration_s":0.001572,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009764,"completed_at":"2026-10-06T14:49:05.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 172.987924] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f058c2fb26ee2240f31221a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f058c2fb26ee2240f31221a: start","job_status":"start","queue_duration_s":1.253756,"scheduling_latency_s":1.253769}1432gitlab # [ 172.999528] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f058c2fb26ee2240f31221a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f058c2fb26ee2240f31221a: done: 0.009481 sec","job_status":"done","queue_duration_s":1.253756,"scheduling_latency_s":1.253769,"redis_calls":13,"redis_duration_s":0.0017490000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-10-06T14:49:05.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 173.039816] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ebdf83d825cd9b5b949fada","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ebdf83d825cd9b5b949fada: start","job_status":"start","queue_duration_s":1.26409,"scheduling_latency_s":1.264103}1434gitlab # [ 173.083201] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ebdf83d825cd9b5b949fada","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ebdf83d825cd9b5b949fada: done: 0.009572 sec","job_status":"done","queue_duration_s":1.26409,"scheduling_latency_s":1.264103,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009572,"completed_at":"2026-10-06T14:49:05.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 173.084251] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44a52d15429c32457417b48c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44a52d15429c32457417b48c: start","job_status":"start","queue_duration_s":1.274497,"scheduling_latency_s":1.274513}1436gitlab # [ 173.129721] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44a52d15429c32457417b48c","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44a52d15429c32457417b48c: done: 0.011072 sec","job_status":"done","queue_duration_s":1.274497,"scheduling_latency_s":1.274513,"redis_calls":13,"redis_duration_s":0.002998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002479,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011072,"completed_at":"2026-10-06T14:49:05.775Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 173.130717] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea2c44f9186199c7c628ea9a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea2c44f9186199c7c628ea9a: start","job_status":"start","queue_duration_s":1.286594,"scheduling_latency_s":1.286608}1438gitlab # [ 173.174758] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea2c44f9186199c7c628ea9a","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea2c44f9186199c7c628ea9a: done: 0.00991 sec","job_status":"done","queue_duration_s":1.286594,"scheduling_latency_s":1.286608,"redis_calls":13,"redis_duration_s":0.001573,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00991,"completed_at":"2026-10-06T14:49:05.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 173.175732] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19f01ff1bfc53cf755c72d7d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19f01ff1bfc53cf755c72d7d: start","job_status":"start","queue_duration_s":1.297373,"scheduling_latency_s":1.297388}1440gitlab # [ 173.219628] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19f01ff1bfc53cf755c72d7d","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19f01ff1bfc53cf755c72d7d: done: 0.009469 sec","job_status":"done","queue_duration_s":1.297373,"scheduling_latency_s":1.297388,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009469,"completed_at":"2026-10-06T14:49:05.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 173.221095] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd01f11f2fc7c07e66f95d1","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd01f11f2fc7c07e66f95d1: start","job_status":"start","queue_duration_s":1.307842,"scheduling_latency_s":1.307856}1442gitlab # [ 173.232727] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fd01f11f2fc7c07e66f95d1","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fd01f11f2fc7c07e66f95d1: done: 0.009477 sec","job_status":"done","queue_duration_s":1.307842,"scheduling_latency_s":1.307856,"redis_calls":13,"redis_duration_s":0.0015710000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006302,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009477,"completed_at":"2026-10-06T14:49:05.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 173.287330] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"189aeacaf1a0e4d2538c4cb6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-189aeacaf1a0e4d2538c4cb6: start","job_status":"start","queue_duration_s":1.318349,"scheduling_latency_s":1.318364}1444gitlab # [ 173.288474] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"189aeacaf1a0e4d2538c4cb6","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-189aeacaf1a0e4d2538c4cb6: done: 0.015659 sec","job_status":"done","queue_duration_s":1.318349,"scheduling_latency_s":1.318364,"redis_calls":13,"redis_duration_s":0.007254999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005729,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015659,"completed_at":"2026-10-06T14:49:05.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 173.336657] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d9103699538b3ef6eeb5b8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d9103699538b3ef6eeb5b8: start","job_status":"start","queue_duration_s":1.335059,"scheduling_latency_s":1.335073}1446gitlab # [ 173.337858] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9d9103699538b3ef6eeb5b8","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9d9103699538b3ef6eeb5b8: done: 0.009561 sec","job_status":"done","queue_duration_s":1.335059,"scheduling_latency_s":1.335073,"redis_calls":13,"redis_duration_s":0.001645,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009561,"completed_at":"2026-10-06T14:49:05.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 173.378316] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c30f53f633ddd0209a2ad54b","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c30f53f633ddd0209a2ad54b: start","job_status":"start","queue_duration_s":1.345599,"scheduling_latency_s":1.345612}1448gitlab # [ 173.379272] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c30f53f633ddd0209a2ad54b","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c30f53f633ddd0209a2ad54b: done: 0.028789 sec","job_status":"done","queue_duration_s":1.345599,"scheduling_latency_s":1.345612,"redis_calls":13,"redis_duration_s":0.017877,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017242,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028789,"completed_at":"2026-10-06T14:49:05.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 173.432903] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3f5a31167482a0ebf9861e3","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3f5a31167482a0ebf9861e3: start","job_status":"start","queue_duration_s":1.375629,"scheduling_latency_s":1.375652}1450gitlab # [ 173.433795] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3f5a31167482a0ebf9861e3","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3f5a31167482a0ebf9861e3: done: 0.053834 sec","job_status":"done","queue_duration_s":1.375629,"scheduling_latency_s":1.375652,"redis_calls":13,"redis_duration_s":0.001924,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.053834,"completed_at":"2026-10-06T14:49:05.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 173.478506] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295e2e3978404dcb524f3ab9","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295e2e3978404dcb524f3ab9: start","job_status":"start","queue_duration_s":1.430489,"scheduling_latency_s":1.430508}1452gitlab # [ 173.479464] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"295e2e3978404dcb524f3ab9","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-295e2e3978404dcb524f3ab9: done: 0.010025 sec","job_status":"done","queue_duration_s":1.430489,"scheduling_latency_s":1.430508,"redis_calls":13,"redis_duration_s":0.001678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010025,"completed_at":"2026-10-06T14:49:05.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 173.536509] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c3f6809b10f3a21aea7b1f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c3f6809b10f3a21aea7b1f: start","job_status":"start","queue_duration_s":1.441376,"scheduling_latency_s":1.441391}1454gitlab # [ 173.537367] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c3f6809b10f3a21aea7b1f","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c3f6809b10f3a21aea7b1f: done: 0.009588 sec","job_status":"done","queue_duration_s":1.441376,"scheduling_latency_s":1.441391,"redis_calls":13,"redis_duration_s":0.001629,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009588,"completed_at":"2026-10-06T14:49:05.941Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 173.577186] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8789ba027fbca1ce74eebbe","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8789ba027fbca1ce74eebbe: start","job_status":"start","queue_duration_s":1.451844,"scheduling_latency_s":1.451858}1456gitlab # [ 173.577907] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8789ba027fbca1ce74eebbe","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8789ba027fbca1ce74eebbe: done: 0.009513 sec","job_status":"done","queue_duration_s":1.451844,"scheduling_latency_s":1.451858,"redis_calls":13,"redis_duration_s":0.0019979999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001432,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009513,"completed_at":"2026-10-06T14:49:05.951Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 173.616833] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdab447fc144a4fa248a2428","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdab447fc144a4fa248a2428: start","job_status":"start","queue_duration_s":1.462228,"scheduling_latency_s":1.462241}1458gitlab # [ 173.617751] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdab447fc144a4fa248a2428","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdab447fc144a4fa248a2428: done: 0.009688 sec","job_status":"done","queue_duration_s":1.462228,"scheduling_latency_s":1.462241,"redis_calls":13,"redis_duration_s":0.001774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009688,"completed_at":"2026-10-06T14:49:05.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 173.662127] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:05.965Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab7cd960b8e1df9b9050495","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab7cd960b8e1df9b9050495: start","job_status":"start","queue_duration_s":1.475109,"scheduling_latency_s":1.475124}1460gitlab # [ 173.662856] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:06.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab7cd960b8e1df9b9050495","created_at":"2026-10-06T14:49:04.434Z","trace_propagation_headers":{"sentry-trace":"0c90ce41bf8c441694720cd51c7e550f-1e63a8253a914986","baggage":"sentry-trace_id=0c90ce41bf8c441694720cd51c7e550f,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"abbfbc6db3314e1400c5c85d4ed31db5","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:04.490Z","job_size_bytes":2,"pid":1645,"sidekiq_tid":"maex","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab7cd960b8e1df9b9050495: done: 0.590922 sec","job_status":"done","queue_duration_s":1.475109,"scheduling_latency_s":1.475124,"redis_calls":13,"redis_duration_s":0.5777519999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.576364,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001388,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.590922,"completed_at":"2026-10-06T14:49:06.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 173.873427] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1456193418 wd_nsec: 14561935391462gitlab # [ 191.318184] postgres[2483]: [2483] ERROR: relation "table_without_models" does not exist1463gitlab # [ 191.318828] postgres[2483]: [2483] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1464gitlab # [ 194.236722] runuser[2267]: pam_unix(runuser:session): session closed for user gitlab1465gitlab # [ 194.239570] setup-gitlab-start[2249]: + systemctl restart gitlab-sidekiq.service1466gitlab # [ 194.268727] systemd[1]: Stopping gitlab-sidekiq.service...1467gitlab # [ 194.270564] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.300Z","message":"Shutting down"}1468gitlab # [ 194.271637] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.302Z","message":"Scheduler exiting..."}1469gitlab # [ 194.276643] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.308Z","message":"Terminating quiet threads for default capsule"}1470gitlab # [ 194.277707] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.308Z","message":"Scheduler exiting..."}1471gitlab # [ 194.778922] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:28.810Z","message":"Pausing to allow jobs to finish..."}1472gitlab # [ 197.784164] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:31.814Z","message":"Bye!"}1473gitlab # [ 197.809438] sidekiq-cluster[1645]: {"severity":"INFO","time":"2026-10-06T14:49:31.841Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1645,"worker_id":"sidekiq_0","memwd_rss_bytes":966451200,"retry":0}1474gitlab # [ 199.019109] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1475gitlab # [ 199.021598] systemd[1]: Stopped gitlab-sidekiq.service.1476gitlab # [ 199.023508] systemd[1]: gitlab-sidekiq.service: Consumed 1min 2.380s CPU time over 2min 1.286s wall clock time, 967.7M memory peak, 4.4M read from disk.1477gitlab # [ 199.028278] systemd[1]: Started gitlab-sidekiq.service.1478gitlab # [ 199.030978] setup-gitlab-start[2249]: + mkdir -p /var/lib/secrets1479gitlab # [ 199.034977] setup-gitlab-start[2249]: + echo nixbot-test-token-of-20-chars1480gitlab # [ 199.037100] setup-gitlab-start[2249]: + chmod 644 /var/lib/secrets/gitlab-token1481gitlab # [ 199.039228] setup-gitlab-start[2249]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1482gitlab # [ 199.310234] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:33 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 2421483gitlab # [ 200.084441] gitaly[891]: time="2026-10-06T14:49:34.115Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.114" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1484gitlab # [ 200.106403] gitaly[891]: time="2026-10-06T14:49:34.137Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.114" grpc.time_ms=1.244 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1485gitlab # [ 200.188447] gitaly[891]: time="2026-10-06T14:49:34.220Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.109" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.219" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1486gitlab # [ 200.212135] gitaly[891]: time="2026-10-06T14:49:34.220Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.109" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.219" grpc.time_ms=0.443 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1487gitlab # [ 200.239273] gitaly[891]: time="2026-10-06T14:49:34.271Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS diskcache=b9b54616-2459-461f-b86a-069e32c2a760 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.115" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.225" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1488gitlab # [ 200.240294] gitaly[891]: time="2026-10-06T14:49:34.271Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1567 command.oublock=32 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.115" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.225" grpc.time_ms=45.54 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 200.250393] gitaly[891]: time="2026-10-06T14:49:34.282Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.281" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1490gitlab # [ 200.250887] gitaly[891]: time="2026-10-06T14:49:34.282Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.171" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.281" grpc.time_ms=0.777 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 200.260779] gitaly[891]: time="2026-10-06T14:49:34.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:44.176" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.286" grpc.time_ms=5.777 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 200.315286] gitaly[891]: time="2026-10-06T14:49:34.347Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.236" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.346" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 200.325495] gitaly[891]: time="2026-10-06T14:49:34.347Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.236" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.346" grpc.time_ms=0.494 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 200.372559] gitaly[891]: time="2026-10-06T14:49:34.404Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS diskcache=4d7447da-4c0e-44f4-8d42-200c61208ded grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.238" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.349" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1495gitlab # [ 200.373528] gitaly[891]: time="2026-10-06T14:49:34.404Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=27 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-06T14:49:44.238" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.349" grpc.time_ms=54.854 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 200.403771] gitaly[891]: time="2026-10-06T14:49:34.435Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.434" pid=891 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1497gitlab # [ 200.404821] gitaly[891]: time="2026-10-06T14:49:34.435Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.434" grpc.time_ms=1.125 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 200.436916] gitaly[891]: time="2026-10-06T14:49:34.468Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:44.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.459" grpc.time_ms=8.933 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 200.485261] gitaly[891]: time="2026-10-06T14:49:34.517Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:49:44.086" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.516" grpc.time_ms=0.223 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 200.503557] gitaly[891]: time="2026-10-06T14:49:34.535Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:49:44.104" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.535" grpc.time_ms=0.255 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 200.952977] gitaly[891]: time="2026-10-06T14:49:34.984Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V1YDM48SM42971HP8JDRS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:44.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:34.978" grpc.time_ms=6.42 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1502gitlab # [ 201.341248] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:35 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 20061503gitlab # [ 201.345842] setup-gitlab-start[2537]: {"id":1,"message":null,"error":null}1504gitlab # [ 202.268052] sidekiq-cluster[2525]: {"severity":"INFO","time":"2026-10-06T14:49:36.281Z","message":"Starting cluster with 1 processes"}1505gitlab # [ 206.471784] gitaly[891]: time="2026-10-06T14:49:40.503Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2596ZRNDHG7RQB5YBGNB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:50.063" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:40.494" grpc.time_ms=8.768 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1506gitlab # [ 206.534992] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:40 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1741507gitlab # [ 206.539765] setup-gitlab-start[2249]: + mkdir -p /tmp/test-flake1508gitlab # [ 206.541433] setup-gitlab-start[2249]: + cd /tmp/test-flake1509gitlab # [ 206.543055] setup-gitlab-start[2249]: + git init -b master1510gitlab # [ 206.563881] setup-gitlab-start[2611]: Initialized empty Git repository in /tmp/test-flake/.git/1511gitlab # [ 206.566737] setup-gitlab-start[2249]: + git config user.name test1512gitlab # [ 206.568761] setup-gitlab-start[2249]: + git config user.email test@example.com1513gitlab # [ 206.571185] setup-gitlab-start[2249]: + cat1514gitlab # [ 206.572647] setup-gitlab-start[2249]: + git add flake.nix1515gitlab # [ 206.574474] setup-gitlab-start[2249]: + git commit -m 'initial commit'1516gitlab # [ 206.592340] setup-gitlab-start[2616]: [master (root-commit) a19aff1] initial commit1517gitlab # [ 206.594804] setup-gitlab-start[2616]: 1 file changed, 10 insertions(+)1518gitlab # [ 206.596189] setup-gitlab-start[2616]: create mode 100644 flake.nix1519gitlab # [ 206.597338] setup-gitlab-start[2249]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1520gitlab # [ 206.605175] setup-gitlab-start[2249]: + git push -u origin master1521gitlab # [ 206.666931] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 311522gitlab # [ 206.944253] gitaly[891]: time="2026-10-06T14:49:40.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V25JXE9MC24JSV2THDNDJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:40.964" grpc.time_ms=11.76 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1523gitlab # [ 206.946049] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:40 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2741524gitlab # [ 207.209709] gitaly[891]: time="2026-10-06T14:49:41.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:51.121" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:41.231" grpc.time_ms=9.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1525gitlab # [ 207.243233] gitaly[891]: time="2026-10-06T14:49:41.275Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-06T14:50:11.065" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-06T14:49:41.266" grpc.time_ms=8.354 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1526gitlab # [ 207.259526] gitaly[891]: time="2026-10-06T14:49:41.291Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M48V25WSJYRJM7HDTYWFNKXD duration_ms=112ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1527gitlab # [ 207.329214] gitaly[891]: time="2026-10-06T14:49:41.360Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M48V25WSJYRJM7HDTYWFNKXD duration_ms=68ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1528gitlab # [ 207.336038] gitaly[891]: time="2026-10-06T14:49:41.362Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.178" grpc.time_ms=182.948 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1529gitlab # [ 207.379928] gitaly[891]: time="2026-10-06T14:49:41.411Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.410" grpc.time_ms=0.94 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1530gitlab # [ 207.429633] gitaly[891]: time="2026-10-06T14:49:41.461Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.460" grpc.time_ms=1.263 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1531gitlab # [ 207.463893] gitaly[891]: time="2026-10-06T14:49:41.495Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.495" grpc.time_ms=0.313 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1532gitlab # [ 207.546413] gitaly[891]: time="2026-10-06T14:49:41.577Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:49:51.139" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:41.570" grpc.time_ms=7.449 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1533gitlab # [ 207.594404] gitaly[891]: time="2026-10-06T14:49:41.626Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1562 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-06T14:49:51.181" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:41.611" grpc.time_ms=14.291 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1534gitlab # [ 207.624250] gitaly[891]: time="2026-10-06T14:49:41.655Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M48V25WSJYRJM7HDTYWFNKXD duration_ms=131ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1535gitlab # [ 207.625086] gitaly[891]: time="2026-10-06T14:49:41.656Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:41.523" grpc.time_ms=132.771 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1536gitlab # [ 207.646469] gitaly[891]: time="2026-10-06T14:49:41.678Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD diskcache=5d6783c4-0861-4b92-ac54-b6c87f658dcc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:41.100" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1537gitlab # [ 207.647227] gitaly[891]: time="2026-10-06T14:49:41.678Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=215 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13711 command.oublock=32 command.real_time_ms=568 command.spawn_token_fork_ms=0 command.system_time_ms=142 command.user_time_ms=73 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:41.100" grpc.time_ms=577.626 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1538gitlab # [ 207.668102] gitlab-workhorse[822]: time="2026-10-06T14:49:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521539gitlab # [ 207.668756] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:41 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6811540gitlab # [ 207.672973] setup-gitlab-start[2620]: To http://gitlab/root/test-flake.git1541gitlab # [ 207.673721] setup-gitlab-start[2620]: * [new branch] master -> master1542gitlab # [ 207.678553] setup-gitlab-start[2620]: branch 'master' set up to track 'origin/master'.1543gitlab # [ 207.682485] systemd[1]: Finished setup-gitlab.service.1544gitlab # [ 207.685263] systemd[1]: Starting nixbot CI service...1545gitlab: (finished: waiting for unit setup-gitlab.service, in 208.60 seconds)1546gitlab: waiting for unit nixbot.service1547gitlab # [ 208.933428] nixbot[2698]: {"ts": "2026-10-06T14:49:42.964Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1548gitlab # [ 208.959104] nixbot[2698]: {"ts": "2026-10-06T14:49:42.990Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1549gitlab # [ 208.971318] nixbot[2698]: {"ts": "2026-10-06T14:49:43.003Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1550gitlab # [ 208.974319] nixbot[2698]: {"ts": "2026-10-06T14:49:43.006Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1551gitlab # [ 208.977102] nixbot[2698]: {"ts": "2026-10-06T14:49:43.008Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1552gitlab # [ 208.981067] nixbot[2698]: {"ts": "2026-10-06T14:49:43.012Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1553gitlab # [ 208.984255] nixbot[2698]: {"ts": "2026-10-06T14:49:43.015Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1554gitlab # [ 208.985595] nixbot[2698]: {"ts": "2026-10-06T14:49:43.017Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1555gitlab # [ 208.989788] nixbot[2698]: {"ts": "2026-10-06T14:49:43.021Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1556gitlab # [ 208.991604] nixbot[2698]: {"ts": "2026-10-06T14:49:43.023Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1557gitlab # [ 208.995197] nixbot[2698]: {"ts": "2026-10-06T14:49:43.027Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1558gitlab # [ 208.999476] nixbot[2698]: {"ts": "2026-10-06T14:49:43.031Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1559gitlab # [ 209.001815] nixbot[2698]: {"ts": "2026-10-06T14:49:43.033Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1560gitlab # [ 209.003628] nixbot[2698]: {"ts": "2026-10-06T14:49:43.035Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1561gitlab # [ 209.006496] nixbot[2698]: {"ts": "2026-10-06T14:49:43.038Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1562gitlab # [ 209.008411] nixbot[2698]: {"ts": "2026-10-06T14:49:43.040Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1563gitlab # [ 209.010267] nixbot[2698]: {"ts": "2026-10-06T14:49:43.042Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1564gitlab # [ 209.012058] nixbot[2698]: {"ts": "2026-10-06T14:49:43.043Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1565gitlab # [ 209.015879] nixbot[2698]: {"ts": "2026-10-06T14:49:43.047Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1566gitlab # [ 209.017455] nixbot[2698]: {"ts": "2026-10-06T14:49:43.049Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1567gitlab # [ 209.018970] nixbot[2698]: {"ts": "2026-10-06T14:49:43.050Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1568gitlab # [ 209.022294] nixbot[2698]: {"ts": "2026-10-06T14:49:43.054Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1569gitlab # [ 209.023917] nixbot[2698]: {"ts": "2026-10-06T14:49:43.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1570gitlab # [ 209.025911] nixbot[2698]: {"ts": "2026-10-06T14:49:43.057Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1571gitlab # [ 209.027470] nixbot[2698]: {"ts": "2026-10-06T14:49:43.059Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1572gitlab # [ 209.029815] nixbot[2698]: {"ts": "2026-10-06T14:49:43.061Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1573gitlab # [ 209.031659] nixbot[2698]: {"ts": "2026-10-06T14:49:43.063Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1574gitlab # [ 209.033209] nixbot[2698]: {"ts": "2026-10-06T14:49:43.065Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1575gitlab # [ 209.034807] nixbot[2698]: {"ts": "2026-10-06T14:49:43.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1576gitlab # [ 209.043436] nixbot[2698]: {"ts": "2026-10-06T14:49:43.075Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1577gitlab # [ 209.048331] nixbot[2698]: {"ts": "2026-10-06T14:49:43.079Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1578gitlab # [ 209.051593] nixbot[2698]: {"ts": "2026-10-06T14:49:43.083Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1579gitlab # [ 209.056145] nixbot[2698]: {"ts": "2026-10-06T14:49:43.087Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1580gitlab # [ 209.061177] nixbot[2698]: {"ts": "2026-10-06T14:49:43.092Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1581gitlab # [ 209.066175] nixbot[2698]: {"ts": "2026-10-06T14:49:43.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1582gitlab # [ 209.070856] nixbot[2698]: {"ts": "2026-10-06T14:49:43.102Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1583gitlab # [ 209.073701] nixbot[2698]: {"ts": "2026-10-06T14:49:43.105Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1584gitlab # [ 209.081191] nixbot[2698]: {"ts": "2026-10-06T14:49:43.113Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1585gitlab # [ 209.394941] nixbot[2698]: INFO: Started server process [2698]1586gitlab # [ 209.397130] nixbot[2698]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1587gitlab # [ 209.416165] nixbot[2698]: INFO: ::ffff:127.0.0.1:47742 - "GET /health HTTP/1.1" 200 OK1588gitlab # [ 209.422072] systemd[1]: Started nixbot CI service.1589gitlab # [ 209.425469] systemd[1]: Reached target Multi-User System.1590gitlab # [ 209.427733] systemd[1]: Startup finished in 1.249s (kernel) + 3.636s (initrd) + 3min 24.540s (userspace) = 3min 29.427s.1591gitlab # [ 209.609919] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:43 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1951592gitlab # [ 209.617916] nixbot[2698]: {"ts": "2026-10-06T14:49:43.643Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1593gitlab # [ 209.644413] nixbot[2698]: {"ts": "2026-10-06T14:49:43.676Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1594gitlab # [ 209.747830] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 851595gitlab # [ 209.752539] nixbot[2698]: {"ts": "2026-10-06T14:49:43.784Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1596gitlab # [ 209.758576] nixbot[2698]: {"ts": "2026-10-06T14:49:43.790Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1597gitlab # [ 209.882299] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1181598gitlab # [ 209.884430] nixbot[2698]: {"ts": "2026-10-06T14:49:43.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1599gitlab: (finished: waiting for unit nixbot.service, in 2.18 seconds)1600gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1601gitlab # [ 210.110937] nixbot[2698]: INFO: ::ffff:127.0.0.1:47754 - "GET /health HTTP/1.1" 200 OK1602gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1603subtest: project discovered and webhook registered1604gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1605gitlab # [ 210.181069] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 491606gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.07 seconds)1607(finished: subtest: project discovered and webhook registered, in 0.07 seconds)1608subtest: push delivers the webhook1609gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1610gitlab # [ 210.546149] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 6441611gitlab # [ 210.548261] nixbot[2698]: {"ts": "2026-10-06T14:49:44.576Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1612gitlab # [ 210.627341] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 671613gitlab # [ 210.632342] nixbot[2698]: {"ts": "2026-10-06T14:49:44.662Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1614gitlab # [ 210.716453] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 771615gitlab # [ 210.722335] nixbot[2698]: {"ts": "2026-10-06T14:49:44.749Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1616gitlab # [ 210.791391] gitaly[891]: time="2026-10-06T14:49:44.822Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29HHM3WQAHX7T5QH669K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-06T14:50:14.610" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:44.811" grpc.time_ms=10.849 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1617gitlab # [ 210.824735] gitaly[891]: time="2026-10-06T14:49:44.831Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29HHM3WQAHX7T5QH669K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:14.630" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:44.831" grpc.time_ms=0.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 210.849161] gitaly[891]: time="2026-10-06T14:49:44.838Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29HHM3WQAHX7T5QH669K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-06T14:49:54.003" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:44.833" grpc.time_ms=4.718 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 210.863591] nixbot[2698]: {"ts": "2026-10-06T14:49:44.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1620gitlab # [ 210.865991] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1031621gitlab # [ 210.900289] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 711622gitlab # [ 210.904815] nixbot[2698]: {"ts": "2026-10-06T14:49:44.933Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1623gitlab # [ 210.909989] nixbot[2698]: {"ts": "2026-10-06T14:49:44.941Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1624gitlab # [ 211.059501] gitaly[891]: time="2026-10-06T14:49:45.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V29T83ZXM0NJRNH3JMZB4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.079" grpc.time_ms=11.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1625gitlab # [ 211.088307] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 581626gitlab # [ 211.199265] gitaly[891]: time="2026-10-06T14:49:45.231Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V29X6476ZYBAVWTTR3SFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.217" pid=891 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1627gitlab # [ 211.221887] gitaly[891]: time="2026-10-06T14:49:45.231Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29X6476ZYBAVWTTR3SFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.217" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1628gitlab # [ 211.246970] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131629gitlab # [ 211.249641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1051630gitlab # [ 211.251539] gitaly[891]: time="2026-10-06T14:49:45.231Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V29X6476ZYBAVWTTR3SFB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.217" grpc.time_ms=13.778 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1631gitlab # [ 211.284775] gitaly[891]: time="2026-10-06T14:49:45.316Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A0MZA9332W111EKSVKZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.305" pid=891 remote_ip="2001:db8:1::1" request_sha=8799cec4b193202d14bee18ece0c1e1190292075 response_bytes=224 span.kind=server system=grpc1632gitlab # [ 211.295626] gitaly[891]: time="2026-10-06T14:49:45.316Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A0MZA9332W111EKSVKZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.305" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1633gitlab # [ 211.309123] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2241634gitlab # [ 211.309673] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 224 "" "git/2.55.0" 801635gitlab # [ 211.310231] gitaly[891]: time="2026-10-06T14:49:45.316Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A0MZA9332W111EKSVKZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.305" grpc.time_ms=11.141 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1636gitlab # [ 211.385399] gitaly[891]: time="2026-10-06T14:49:45.417Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2A4WBB3D43NF48CHJSRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.406" grpc.time_ms=10.871 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1637gitlab # [ 211.386834] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451638gitlab # [ 211.486650] gitaly[891]: time="2026-10-06T14:49:45.518Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A6VWXVFZCR92TRNRPJ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.506" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1639gitlab # [ 211.488305] gitaly[891]: time="2026-10-06T14:49:45.518Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A6VWXVFZCR92TRNRPJ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.506" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1640gitlab # [ 211.490860] gitaly[891]: time="2026-10-06T14:49:45.521Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2A6VWXVFZCR92TRNRPJ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.506" grpc.time_ms=14.787 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1641gitlab # [ 211.492060] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671642gitlab # [ 211.493124] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 861643gitlab # [ 211.641909] gitaly[891]: time="2026-10-06T14:49:45.673Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V2AC5DTNGTN76DDTF45HP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.660" grpc.time_ms=13.345 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1644gitlab # [ 211.645294] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 701645gitlab # [ 211.766764] gitaly[891]: time="2026-10-06T14:49:45.797Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2AFA3CKXP8QG214MJBSC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.769" pid=891 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1646gitlab # [ 211.768528] gitaly[891]: time="2026-10-06T14:49:45.798Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2AFA3CKXP8QG214MJBSC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.769" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1647gitlab # [ 211.770584] gitlab-workhorse[822]: time="2026-10-06T14:49:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091648gitlab # [ 211.772255] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 921649gitlab # [ 211.773432] gitaly[891]: time="2026-10-06T14:49:45.798Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1166 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2AFA3CKXP8QG214MJBSC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:49:45.769" grpc.time_ms=28.652 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1650gitlab # [ 211.945286] gitaly[891]: time="2026-10-06T14:49:45.975Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:15.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:45.973" grpc.time_ms=0.986 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 212.019691] gitaly[891]: time="2026-10-06T14:49:46.051Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-06T14:50:16.038" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.039" grpc.time_ms=11.995 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 212.085412] gitaly[891]: time="2026-10-06T14:49:46.117Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:49:56.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.103" grpc.time_ms=13.672 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 212.137712] gitaly[891]: time="2026-10-06T14:49:46.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:49:56.056" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.156" grpc.time_ms=12.56 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 212.223684] gitaly[891]: time="2026-10-06T14:49:46.255Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:49:56.153" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:46.254" grpc.time_ms=0.56 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 212.241294] gitaly[891]: time="2026-10-06T14:49:46.273Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:49:56.164" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:46.265" grpc.time_ms=7.584 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 212.314365] gitaly[891]: time="2026-10-06T14:49:46.346Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:46.345" grpc.time_ms=0.579 pid=891 span.kind=server system=grpc1657gitlab # [ 212.348542] gitaly[891]: time="2026-10-06T14:49:46.380Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:49:46.379" grpc.time_ms=1.084 pid=891 span.kind=server system=grpc1658gitlab # [ 212.368562] gitaly[891]: time="2026-10-06T14:49:46.400Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV diskcache=1089e014-e222-42b3-a181-c8466d02fd43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:49:56.206" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:46.307" pid=891 ref=refs/keep-around/a19aff1adb0d9b72e397bc88315b31884feb66bc remote_ip="2001:db8:1::1" revision=a19aff1adb0d9b72e397bc88315b31884feb66bc span.kind=server system=grpc username=root1659gitlab # [ 212.369200] gitaly[891]: time="2026-10-06T14:49:46.400Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=66 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5522 command.oublock=8 command.real_time_ms=82 command.spawn_token_fork_ms=3 command.system_time_ms=48 command.user_time_ms=18 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:49:56.206" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:49:46.307" grpc.time_ms=93.491 pid=891 ref=refs/keep-around/a19aff1adb0d9b72e397bc88315b31884feb66bc remote_ip="2001:db8:1::1" revision=a19aff1adb0d9b72e397bc88315b31884feb66bc span.kind=server system=grpc username=root1660gitlab # [ 212.372882] gitaly[891]: time="2026-10-06T14:49:46.404Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:16.403" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:46.404" grpc.time_ms=0.39 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 212.495538] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 6241662gitlab # [ 212.497896] nixbot[2698]: {"ts": "2026-10-06T14:49:46.527Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1663gitlab # [ 212.507448] nixbot[2698]: {"ts": "2026-10-06T14:49:46.538Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-a19aff1adb0d-0"}1664gitlab # [ 212.689808] nixbot[2698]: {"ts": "2026-10-06T14:49:46.721Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-a19aff1adb0d-0", "argv0": "bwrap"}1665gitlab # [ 212.797098] systemd[1]: Started Nix Daemon.1666gitlab # [ 212.861058] nix-daemon[2873]: accepted connection from pid 2868, user nixbot1667gitlab # [ 217.090730] nix-daemon[2873]: accepted connection from pid 2915, user nixbot1668gitlab # [ 217.112502] nix-daemon[2873]: accepted connection from pid 2868, user nixbot1669gitlab # [ 221.578986] nix-daemon[2873]: accepted connection from pid 2868, user nixbot1670gitlab # [ 221.671126] nix-daemon[2873]: accepted connection from pid 2964, user nixbot1671gitlab # [ 221.714206] gitaly[891]: time="2026-10-06T14:49:55.745Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2M7HKBGVWS2YBZSNEXGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:25.543" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:55.744" grpc.time_ms=0.746 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 221.893870] gitaly[891]: time="2026-10-06T14:49:55.925Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V2M7HKBGVWS2YBZSNEXGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:05.083" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:55.913" grpc.time_ms=11.916 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 221.985700] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3181674gitlab # [ 221.987896] nixbot[2698]: {"ts": "2026-10-06T14:49:56.017Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1675gitlab # [ 222.056651] gitaly[891]: time="2026-10-06T14:49:56.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2MHNPGA8QP4J6M8N6KNA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:26.086" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:49:56.087" grpc.time_ms=0.913 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 222.124470] gitaly[891]: time="2026-10-06T14:49:56.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V2MHNPGA8QP4J6M8N6KNA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:06.044" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:49:56.144" grpc.time_ms=11.289 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1677gitlab # [ 222.197341] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:49:56 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2061678gitlab # [ 222.203281] nixbot[2698]: {"ts": "2026-10-06T14:49:56.230Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1679gitlab # [ 226.403043] nix-daemon[2873]: accepted connection from pid 3025, user nixbot1680gitlab # [ 226.471098] gitaly[891]: time="2026-10-06T14:50:00.501Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2RW6S4207MNZA3VES4HC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:50:30.294" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:00.495" grpc.time_ms=6.092 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 226.497270] gitaly[891]: time="2026-10-06T14:50:00.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2RW6S4207MNZA3VES4HC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:10.092" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:00.523" grpc.time_ms=5.703 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 226.535169] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:00 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1111683gitlab # [ 226.538770] nixbot[2698]: {"ts": "2026-10-06T14:50:00.567Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1684gitlab # [ 226.800488] gitaly[891]: time="2026-10-06T14:50:00.832Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V2S6F6CVR5WZJYAR0007G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.822" grpc.time_ms=9.565 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1685gitlab # [ 226.819649] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 671686gitlab # [ 226.887933] gitaly[891]: time="2026-10-06T14:50:00.919Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2S8M0EW6HF20AQDCE8M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.912" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1687gitlab # [ 226.889445] gitaly[891]: time="2026-10-06T14:50:00.920Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2S8M0EW6HF20AQDCE8M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.912" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1688gitlab # [ 226.890933] gitaly[891]: time="2026-10-06T14:50:00.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2S8M0EW6HF20AQDCE8M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:00.912" grpc.time_ms=7.992 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1689gitlab # [ 226.892417] gitlab-workhorse[822]: time="2026-10-06T14:50:00Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671690gitlab # [ 226.894138] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:00 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 681691gitlab # [ 227.003071] gitaly[891]: time="2026-10-06T14:50:01.034Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2SCTKZJWNBFZVR556N94 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.028" grpc.time_ms=6.147 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1692gitlab # [ 227.016375] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 611693gitlab # [ 227.065535] gitaly[891]: time="2026-10-06T14:50:01.097Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2SETXAD6VNFPNWV5044N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.086" pid=891 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1694gitlab # [ 227.067261] gitaly[891]: time="2026-10-06T14:50:01.097Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2SETXAD6VNFPNWV5044N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.086" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1695gitlab # [ 227.095080] gitaly[891]: time="2026-10-06T14:50:01.126Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2SETXAD6VNFPNWV5044N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:01.086" grpc.time_ms=10.936 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1696gitlab # [ 227.108486] gitlab-workhorse[822]: time="2026-10-06T14:50:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671697gitlab # [ 227.110462] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 761698gitlab # [ 228.526373] sidekiq-cluster[2584]: 2026-10-06T14:50:02.557Z pid=2584 tid=xbk INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2584, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431861760}1699gitlab # [ 228.708235] sidekiq-cluster[2584]: W, [2026-10-06T14:50:02.739684 #2584] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1700gitlab # [ 228.746460] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:02.778Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1701gitlab # [ 230.559913] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:04.590Z","message":"GitLab reliable fetch activated!"}1702gitlab # [ 230.562401] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:04.591Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1703gitlab # [ 251.316416] postgres[3275]: [3275] ERROR: relation "table_without_models" does not exist1704gitlab # [ 251.318500] postgres[3275]: [3275] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1705gitlab # [ 253.749591] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.780Z","message":"Booted Rails 7.2.3.1 application in production environment"}1706gitlab # [ 253.752411] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.784Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1707gitlab # [ 253.753843] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.784Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1708gitlab # [ 253.755361] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.784Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1709gitlab # [ 253.756576] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:27.785Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1710gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 43.69 seconds)1711gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1712gitlab # [ 253.972462] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 431713gitlab # [ 254.055444] gitaly[891]: time="2026-10-06T14:50:28.085Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KS9GBGF5FH7F3RF9W71 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:28.072" grpc.time_ms=12.938 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1714gitlab # [ 254.056852] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:28 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 761715gitlab # Enumerating objects: 5, done.1716gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1717gitlab # Delta compression using up to 4 threads1718gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1719gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1720gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1721gitlab # [ 254.390465] gitaly[891]: time="2026-10-06T14:50:28.422Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-06T14:50:58.210" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-06T14:50:28.410" grpc.time_ms=11.089 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 254.434262] gitaly[891]: time="2026-10-06T14:50:28.466Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 duration_ms=117ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/allowed"1723gitlab # [ 254.476318] gitaly[891]: time="2026-10-06T14:50:28.508Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 duration_ms=41ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/pre_receive"1724gitlab # [ 254.483421] gitaly[891]: time="2026-10-06T14:50:28.508Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.348" grpc.time_ms=160.319 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 254.542307] gitaly[891]: time="2026-10-06T14:50:28.573Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.573" grpc.time_ms=0.77 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1726gitlab # [ 254.609787] gitaly[891]: time="2026-10-06T14:50:28.639Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.639" grpc.time_ms=0.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1727gitlab # [ 254.663887] gitaly[891]: time="2026-10-06T14:50:28.695Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.695" grpc.time_ms=0.465 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1728gitlab # [ 254.737629] gitaly[891]: time="2026-10-06T14:50:28.769Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 duration_ms=38ns method=POST pid=891 status=200 url="http://unix/api/v4/internal/post_receive"1729gitlab # [ 254.738881] gitaly[891]: time="2026-10-06T14:50:28.770Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:28.730" grpc.time_ms=39.97 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 254.779294] gitaly[891]: time="2026-10-06T14:50:28.811Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 diskcache=115893cf-ba5c-47dc-8a40-26d60c171670 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:28.267" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1731gitlab # [ 254.796899] gitaly[891]: time="2026-10-06T14:50:28.828Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=247 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=13533 command.oublock=32 command.real_time_ms=530 command.spawn_token_fork_ms=0 command.system_time_ms=156 command.user_time_ms=91 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:28.267" grpc.time_ms=543.34 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1732gitlab # To http://gitlab/root/test-flake.git1733gitlab # [ 254.798369] gitlab-workhorse[822]: time="2026-10-06T14:50:28Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521734gitlab # a19aff1..1ff6467 [ 254.800483] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:28 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 7031735gitlab # master -> master1736gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.95 seconds)1737gitlab: must succeed: git -C /tmp/test-flake rev-parse master1738gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1739gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1740gitlab # [ 254.906604] nixbot[2698]: INFO: ::ffff:127.0.0.1:35062 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1741gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.08 seconds)1742gitlab # [ 255.246810] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.277Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"93c9656d1e19078cdab6f5dd","created_at":"2026-10-06T14:49:34.302Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.328Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-93c9656d1e19078cdab6f5dd: start","job_status":"start","queue_duration_s":54.949327,"scheduling_latency_s":54.94937}1743gitlab # [ 255.507123] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.538Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"93c9656d1e19078cdab6f5dd","created_at":"2026-10-06T14:49:34.302Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.328Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-93c9656d1e19078cdab6f5dd: done: 0.260651 sec","job_status":"done","queue_duration_s":54.949327,"scheduling_latency_s":54.94937,"redis_calls":25,"redis_duration_s":0.008996,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.004964,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002349,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.119093907,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.260651,"completed_at":"2026-10-06T14:50:29.538Z","load_balancing_strategy":"primary","db_duration_s":0.065695,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1744gitlab # [ 255.555760] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.587Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5f7e4b854831f146eb6acb16","created_at":"2026-10-06T14:49:34.338Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.342Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5f7e4b854831f146eb6acb16: start","job_status":"start","queue_duration_s":55.244671,"scheduling_latency_s":55.24471}1745gitlab # [ 255.694195] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.725Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"5f7e4b854831f146eb6acb16","created_at":"2026-10-06T14:49:34.338Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.342Z","job_size_bytes":2,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-5f7e4b854831f146eb6acb16: done: 0.138569 sec","job_status":"done","queue_duration_s":55.244671,"scheduling_latency_s":55.24471,"redis_calls":14,"redis_duration_s":0.003833,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001838,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.095759936,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.138569,"completed_at":"2026-10-06T14:50:29.725Z","load_balancing_strategy":"primary","db_duration_s":0.028016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1746gitlab # [ 255.773692] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.804Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1d8740fe8b03a51e660d39c1","created_at":"2026-10-06T14:49:34.851Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.857Z","job_size_bytes":5,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1d8740fe8b03a51e660d39c1: start","job_status":"start","queue_duration_s":54.947382,"scheduling_latency_s":54.947431}1747gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1748gitlab # [ 255.947627] nixbot[2698]: INFO: ::ffff:127.0.0.1:35074 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1749gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds)1750gitlab # [ 255.964520] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:29.995Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"1d8740fe8b03a51e660d39c1","created_at":"2026-10-06T14:49:34.851Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.857Z","job_size_bytes":5,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-1d8740fe8b03a51e660d39c1: done: 0.191164 sec","job_status":"done","queue_duration_s":54.947382,"scheduling_latency_s":54.947431,"redis_calls":12,"redis_duration_s":0.0036769999999999997,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000722,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002374,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.13544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052772,"duration_s":0.191164,"completed_at":"2026-10-06T14:50:29.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028787,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1751gitlab # [ 256.033755] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5eac0356ed56d367d969cdd0","created_at":"2026-10-06T14:49:34.898Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.905Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5eac0356ed56d367d969cdd0: start","job_status":"start","queue_duration_s":55.159519,"scheduling_latency_s":55.159563}1752gitlab # [ 256.263832] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.294Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"5eac0356ed56d367d969cdd0","created_at":"2026-10-06T14:49:34.898Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.905Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-5eac0356ed56d367d969cdd0: done: 0.229552 sec","job_status":"done","queue_duration_s":55.159519,"scheduling_latency_s":55.159563,"redis_calls":11,"redis_duration_s":0.003077,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000853,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.188,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.188,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000332724,"duration_s":0.229552,"completed_at":"2026-10-06T14:50:30.294Z","load_balancing_strategy":"primary","db_duration_s":0.084268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1753gitlab # [ 256.266761] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.295Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"72a2ae54513721aa2046d044","created_at":"2026-10-06T14:49:34.910Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.917Z","job_size_bytes":89,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-72a2ae54513721aa2046d044: start","job_status":"start","queue_duration_s":55.378752,"scheduling_latency_s":55.378766}1754gitlab # [ 256.412162] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.443Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"72a2ae54513721aa2046d044","created_at":"2026-10-06T14:49:34.910Z","trace_propagation_headers":{"sentry-trace":"e03c23e20e024a8d8dde53d5e284749d-3598a12a03444a00","baggage":"sentry-trace_id=e03c23e20e024a8d8dde53d5e284749d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V1YDM48SM42971HP8JDRS","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:34.917Z","job_size_bytes":89,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-72a2ae54513721aa2046d044: done: 0.14742 sec","job_status":"done","queue_duration_s":55.378752,"scheduling_latency_s":55.378766,"redis_calls":11,"redis_duration_s":0.003115,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000731,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000539,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051934,"duration_s":0.14742,"completed_at":"2026-10-06T14:50:30.443Z","load_balancing_strategy":"primary","db_duration_s":0.007793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755gitlab # [ 256.475723] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.506Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a19aff1adb0d9b72e397bc88315b31884feb66bc refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a97ff664faa41b660d336c99","created_at":"2026-10-06T14:49:41.551Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-cb0f6728aab441ce","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:41.556Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a97ff664faa41b660d336c99: start","job_status":"start","queue_duration_s":48.950335,"scheduling_latency_s":48.95037}1756gitlab # [ 256.501066] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:30.532Z","message":"changes: \"0000000000000000000000000000000000000000 a19aff1adb0d9b72e397bc88315b31884feb66bc refs/heads/master\\n\""}1757gitlab # [ 256.552797] gitaly[891]: time="2026-10-06T14:50:30.583Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:40.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:30.572" grpc.time_ms=11.397 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1758gitlab # [ 256.585844] gitaly[891]: time="2026-10-06T14:50:30.617Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:50:40.038" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.608" grpc.time_ms=8.566 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759gitlab # [ 256.658712] gitaly[891]: time="2026-10-06T14:50:30.690Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-06T14:50:40.107" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:30.677" grpc.time_ms=12.518 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760gitlab # [ 256.714512] gitaly[891]: time="2026-10-06T14:50:30.746Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:30.745" grpc.time_ms=0.657 pid=891 span.kind=server system=grpc1761gitlab # [ 256.773816] gitaly[891]: time="2026-10-06T14:50:30.805Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:30.804" grpc.time_ms=0.582 pid=891 span.kind=server system=grpc1762gitlab # [ 256.806307] gitaly[891]: time="2026-10-06T14:50:30.838Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD diskcache=8a0b7bd1-a195-48dd-903f-6c2c1384f6b3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:40.136" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.706" pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1763gitlab # [ 256.816507] gitaly[891]: time="2026-10-06T14:50:30.848Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5138 command.oublock=8 command.real_time_ms=119 command.spawn_token_fork_ms=0 command.system_time_ms=92 command.user_time_ms=37 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:40.136" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.706" grpc.time_ms=131.445 pid=891 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1764gitlab # [ 256.828617] gitaly[891]: time="2026-10-06T14:50:30.860Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-06T14:50:40.289" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:30.859" grpc.time_ms=0.316 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 256.852756] gitaly[891]: time="2026-10-06T14:50:30.884Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=942 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-06T14:50:40.007" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:30.867" grpc.time_ms=16.656 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1767gitlab # [ 256.953751] gitaly[891]: time="2026-10-06T14:50:30.985Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-06T14:51:00.076" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:30.976" grpc.time_ms=8.384 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds)1769gitlab # [ 256.986853] gitaly[891]: time="2026-10-06T14:50:31.010Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:50:41.009" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:31.009" grpc.time_ms=0.339 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 257.004780] gitaly[891]: time="2026-10-06T14:50:31.025Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=342 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-06T14:50:41.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-06T14:50:31.011" grpc.time_ms=14.142 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 257.017422] nixbot[2698]: INFO: ::ffff:127.0.0.1:35088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1772gitlab # [ 257.019455] gitaly[891]: time="2026-10-06T14:50:31.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:41.034" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:31.034" grpc.time_ms=8.099 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 257.031307] gitaly[891]: time="2026-10-06T14:50:31.058Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:41.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:31.050" grpc.time_ms=7.102 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774gitlab # [ 257.049575] gitaly[891]: time="2026-10-06T14:50:31.081Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=961 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-06T14:51:01.069" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:31.069" grpc.time_ms=11.579 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 257.440070] gitaly[891]: time="2026-10-06T14:50:31.471Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-06T14:50:41.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:31.470" grpc.time_ms=1.413 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 257.495476] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.525Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 a19aff1adb0d9b72e397bc88315b31884feb66bc refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"a97ff664faa41b660d336c99","created_at":"2026-10-06T14:49:41.551Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-cb0f6728aab441ce","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:49:41.556Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-a97ff664faa41b660d336c99: done: 1.018862 sec","job_status":"done","queue_duration_s":48.950335,"scheduling_latency_s":48.95037,"gitaly_calls":13,"gitaly_duration_s":0.306354,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.061478000000000005,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.004217,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006903,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001928,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004859,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.021138,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.022433,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.19,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.213,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.574184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000875809,"exclusive_lock_hold_duration_s":0.038322747,"duration_s":1.018862,"completed_at":"2026-10-06T14:50:31.525Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.104533,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1777gitlab # [ 257.543509] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.574Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ab1f2197ba1b759906825268","created_at":"2026-10-06T14:49:46.413Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.422Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ab1f2197ba1b759906825268: start","job_status":"start","queue_duration_s":45.152591,"scheduling_latency_s":45.152636}1778gitlab # [ 257.724222] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.755Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ab1f2197ba1b759906825268","created_at":"2026-10-06T14:49:46.413Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.422Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ab1f2197ba1b759906825268: done: 0.180547 sec","job_status":"done","queue_duration_s":45.152591,"scheduling_latency_s":45.152636,"redis_calls":16,"redis_duration_s":0.005030000000000001,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002818,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000536102,"duration_s":0.180547,"completed_at":"2026-10-06T14:50:31.755Z","load_balancing_strategy":"primary","db_duration_s":0.024333,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1779gitlab # [ 257.804559] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.835Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"1cda2610e49d82994e197fc1","created_at":"2026-10-06T14:49:46.422Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.427Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-1cda2610e49d82994e197fc1: start","job_status":"start","queue_duration_s":45.407978,"scheduling_latency_s":45.408028}1780gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1781gitlab # [ 257.935630] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.967Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"1cda2610e49d82994e197fc1","created_at":"2026-10-06T14:49:46.422Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.427Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-1cda2610e49d82994e197fc1: done: 0.131593 sec","job_status":"done","queue_duration_s":45.407978,"scheduling_latency_s":45.408028,"redis_calls":21,"redis_duration_s":0.005916,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003024,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001489,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000319873,"duration_s":0.131593,"completed_at":"2026-10-06T14:50:31.967Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034596,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1782gitlab # [ 257.939782] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:31.968Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b065b3efcc43c86e238162f7","created_at":"2026-10-06T14:49:46.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.513Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b065b3efcc43c86e238162f7: start","job_status":"start","queue_duration_s":45.454729,"scheduling_latency_s":45.454744}1783gitlab # [ 258.033655] nixbot[2698]: INFO: ::ffff:127.0.0.1:35096 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1784gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds)1785gitlab # [ 258.200866] gitaly[891]: time="2026-10-06T14:50:32.231Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:32.231" grpc.time_ms=0.337 pid=891 span.kind=server system=grpc1786gitlab # [ 258.254848] gitaly[891]: time="2026-10-06T14:50:32.286Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:32.286" grpc.time_ms=0.296 pid=891 span.kind=server system=grpc1787gitlab # [ 258.316376] gitaly[891]: time="2026-10-06T14:50:32.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:32.347" grpc.time_ms=0.464 pid=891 span.kind=server system=grpc1788gitlab # [ 258.350961] gitaly[891]: time="2026-10-06T14:50:32.382Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV diskcache=061e4d68-20b3-41c2-b676-68fd99ef85ac grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:02.190" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.190" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 258.351858] gitaly[891]: time="2026-10-06T14:50:32.383Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=179 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7311 command.oublock=0 command.real_time_ms=181 command.spawn_token_fork_ms=0 command.system_time_ms=122 command.user_time_ms=57 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:02.190" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.190" grpc.time_ms=192.146 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 258.502146] gitaly[891]: time="2026-10-06T14:50:32.533Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:02.531" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.532" grpc.time_ms=1.354 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 258.579734] gitaly[891]: time="2026-10-06T14:50:32.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V2ANDD32WNJXBXCKEM5NV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:02.608" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.609" grpc.time_ms=1.362 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 258.593775] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.624Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b065b3efcc43c86e238162f7","created_at":"2026-10-06T14:49:46.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.513Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2584,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b065b3efcc43c86e238162f7: rescheduled"}1793gitlab # [ 258.603729] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.635Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"b065b3efcc43c86e238162f7","created_at":"2026-10-06T14:49:46.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-56b172f20abf498d","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:49:46.513Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b065b3efcc43c86e238162f7: done: 0.666719 sec","job_status":"done","queue_duration_s":45.454729,"scheduling_latency_s":45.454744,"gitaly_calls":3,"gitaly_duration_s":0.232045,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.033217,"redis_read_bytes":460,"redis_write_bytes":29298,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001435,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002249,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011669,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005142,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15585,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.00776,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000557,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000486,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002484,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.149,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.023,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.117,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.253447,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.512489437,"duration_s":0.666719,"completed_at":"2026-10-06T14:50:32.635Z","load_balancing_strategy":"primary","db_duration_s":0.16204,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1794gitlab # [ 258.668208] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.636Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a19aff1adb0d9b72e397bc88315b31884feb66bc 1ff64674a261f25f1aea4f39330a7ad87ce52348 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1910dd18ec2debc324d0ff49","created_at":"2026-10-06T14:50:28.754Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-a25f1cc4a36549eb","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:50:28.756Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1910dd18ec2debc324d0ff49: start","job_status":"start","queue_duration_s":3.879825,"scheduling_latency_s":3.879841}1795gitlab # [ 258.669230] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.644Z","message":"changes: \"a19aff1adb0d9b72e397bc88315b31884feb66bc 1ff64674a261f25f1aea4f39330a7ad87ce52348 refs/heads/master\\n\""}1796gitlab # [ 258.670080] gitaly[891]: time="2026-10-06T14:50:32.668Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:42.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.657" grpc.time_ms=10.92 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab # [ 258.731840] gitaly[891]: time="2026-10-06T14:50:32.763Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-06T14:50:42.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:32.753" grpc.time_ms=9.605 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 258.744598] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.768Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"57941564bb990e5465376949","created_at":"2026-10-06T14:50:32.766Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"32618e02c34e43470a3d6d04","job_size_bytes":46,"pid":2584,"job_status":"deduplicated","message":"ProjectCacheWorker JID-57941564bb990e5465376949: deduplicated: until executing","deduplication.type":"until executing"}1799gitlab # [ 258.768728] gitaly[891]: time="2026-10-06T14:50:32.800Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-06T14:50:42.040" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.790" grpc.time_ms=9.928 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 258.782646] gitaly[891]: time="2026-10-06T14:50:32.814Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=656 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-06T14:51:02.803" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.804" grpc.time_ms=10.125 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 258.813788] gitaly[891]: time="2026-10-06T14:50:32.845Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-06T14:50:42.088" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-06T14:50:32.838" grpc.time_ms=6.864 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1802gitlab # [ 258.833330] gitaly[891]: time="2026-10-06T14:50:32.864Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:42.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:32.854" grpc.time_ms=10.579 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 258.934543] gitaly[891]: time="2026-10-06T14:50:32.966Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-06T14:50:42.213" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:32.964" grpc.time_ms=1.331 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 258.963169] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.988Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","a19aff1adb0d9b72e397bc88315b31884feb66bc 1ff64674a261f25f1aea4f39330a7ad87ce52348 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"1910dd18ec2debc324d0ff49","created_at":"2026-10-06T14:50:28.754Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-a25f1cc4a36549eb","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-06T14:50:28.756Z","job_size_bytes":185,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-1910dd18ec2debc324d0ff49: done: 0.352248 sec","job_status":"done","queue_duration_s":3.879825,"scheduling_latency_s":3.879841,"gitaly_calls":7,"gitaly_duration_s":0.182619,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.034427,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001873,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001084,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004233,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.017612,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.009625,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.025,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.025,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000474642,"exclusive_lock_hold_duration_s":0.098344622,"duration_s":0.352248,"completed_at":"2026-10-06T14:50:32.988Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026912,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1805gitlab # [ 259.015813] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:32.990Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"32618e02c34e43470a3d6d04","created_at":"2026-10-06T14:50:30.620Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.646Z","job_size_bytes":46,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-32618e02c34e43470a3d6d04: start","job_status":"start","queue_duration_s":2.344513,"scheduling_latency_s":2.344532}1806gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1807gitlab # [ 259.016642] gitaly[891]: time="2026-10-06T14:50:33.028Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-06T20:50:33.022" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:33.022" grpc.time_ms=5.081 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 259.052785] gitaly[891]: time="2026-10-06T14:50:33.084Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=49 command.spawn_token_fork_ms=41 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-06T14:51:03.032" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.033" grpc.time_ms=50.891 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 259.077410] nixbot[2698]: INFO: ::ffff:127.0.0.1:35102 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1810gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds)1811gitlab # [ 259.087372] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.118Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"32618e02c34e43470a3d6d04","created_at":"2026-10-06T14:50:30.620Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.646Z","job_size_bytes":46,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-32618e02c34e43470a3d6d04: done: 0.127884 sec","job_status":"done","queue_duration_s":2.344513,"scheduling_latency_s":2.344532,"gitaly_calls":2,"gitaly_duration_s":0.060516,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007567,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001721,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000777,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001463,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002871,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000735,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000300038,"duration_s":0.127884,"completed_at":"2026-10-06T14:50:33.118Z","load_balancing_strategy":"primary","db_duration_s":0.014281,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1812gitlab # [ 259.128466] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.120Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e97128485d2542f767e86501","created_at":"2026-10-06T14:50:30.666Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.672Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e97128485d2542f767e86501: start","job_status":"start","queue_duration_s":2.447802,"scheduling_latency_s":2.447819}1813gitlab # [ 259.140313] gitaly[891]: time="2026-10-06T14:50:33.172Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD diskcache=ab4c5449-47de-4b5b-a6ae-365451e97d79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:33.137" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.138" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 259.141201] gitaly[891]: time="2026-10-06T14:50:33.172Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:33.137" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.138" grpc.time_ms=34.104 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 259.190105] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.221Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e97128485d2542f767e86501","created_at":"2026-10-06T14:50:30.666Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.672Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e97128485d2542f767e86501: done: 0.101182 sec","job_status":"done","queue_duration_s":2.447802,"scheduling_latency_s":2.447819,"gitaly_calls":1,"gitaly_duration_s":0.03706,"redis_calls":15,"redis_duration_s":0.003703,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000583,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.024,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07971376299999999,"duration_s":0.101182,"completed_at":"2026-10-06T14:50:33.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816gitlab # [ 259.192530] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.223Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"fafeb129f063065d2a5059bc","created_at":"2026-10-06T14:50:30.854Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.856Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-fafeb129f063065d2a5059bc: start","job_status":"start","queue_duration_s":2.366673,"scheduling_latency_s":2.3667}1817gitlab # [ 259.234962] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.264Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"fafeb129f063065d2a5059bc","created_at":"2026-10-06T14:50:30.854Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:30.856Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-fafeb129f063065d2a5059bc: done: 0.041137 sec","job_status":"done","queue_duration_s":2.366673,"scheduling_latency_s":2.3667,"gitaly_calls":1,"gitaly_duration_s":0.012448,"redis_calls":16,"redis_duration_s":0.004322,"redis_read_bytes":52,"redis_write_bytes":2046,"redis_queues_calls":1,"redis_queues_duration_s":0.00031,"redis_queues_read_bytes":1,"redis_queues_write_bytes":977,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001646,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041137,"completed_at":"2026-10-06T14:50:33.264Z","load_balancing_strategy":"primary","db_duration_s":0.003024,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1818gitlab # [ 259.246531] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:33.265Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0c61f92910e0e438fd633efc","created_at":"2026-10-06T14:50:31.337Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6a0415031c179e8d1668422f321c3ed1878b19d3d387de5b6ddca54f1eca0132","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.344Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0c61f92910e0e438fd633efc: start","job_status":"start","queue_duration_s":1.921793,"scheduling_latency_s":1.92181}1819gitlab # [ 259.285444] gitaly[891]: time="2026-10-06T14:50:33.257Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-06T14:51:03.246" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.247" grpc.time_ms=10.594 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 259.286077] gitaly[891]: time="2026-10-06T14:50:33.284Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:03.283" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.283" grpc.time_ms=0.659 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 259.286731] gitaly[891]: time="2026-10-06T14:50:33.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:50:43.287" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:33.287" grpc.time_ms=5.259 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 259.337797] gitaly[891]: time="2026-10-06T14:50:33.369Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:03.368" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.368" grpc.time_ms=0.764 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 259.351717] gitaly[891]: time="2026-10-06T14:50:33.383Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=32 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-06T14:51:03.381" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.381" grpc.time_ms=2.253 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 259.448582] gitaly[891]: time="2026-10-06T14:50:33.480Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:43.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:33.468" grpc.time_ms=11.524 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 259.879875] gitaly[891]: time="2026-10-06T14:50:33.911Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-06T14:51:03.892" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.892" grpc.time_ms=18.8 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 259.926495] gitaly[891]: time="2026-10-06T14:50:33.958Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V25WSJYRJM7HDTYWFNKXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-06T14:51:03.048" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:33.948" grpc.time_ms=9.15 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 259.990443] sidekiq-cluster[2584]: {"severity":"WARN","time":"2026-10-06T14:50:34.021Z","class":"CreatePipelineWorker","correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"a19aff1adb0d9b72e397bc88315b31884feb66bc","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"a19aff1adb0d9b72e397bc88315b31884feb66bc","ref":"refs/heads/master"},"retry":0}1828gitlab # [ 259.999846] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.030Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0c61f92910e0e438fd633efc","created_at":"2026-10-06T14:50:31.337Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6a0415031c179e8d1668422f321c3ed1878b19d3d387de5b6ddca54f1eca0132","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.344Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0c61f92910e0e438fd633efc: done: 0.765021 sec","job_status":"done","queue_duration_s":1.921793,"scheduling_latency_s":1.92181,"gitaly_calls":7,"gitaly_duration_s":0.143568,"redis_calls":51,"redis_duration_s":0.010224,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000865,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004144,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002517,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.573891,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000564038,"duration_s":0.765021,"completed_at":"2026-10-06T14:50:34.030Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047146,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1830gitlab # [ 260.063799] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.033Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"36075e5e-63e2-4bc6-a23b-ff8885e53566\"}"],"class":"WebHookWorker","jid":"3ae87903fe73394ada06fc8a","created_at":"2026-10-06T14:50:31.445Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5375b8baa898758642a05cd2d1adcd26aeba313f82e205b62561a33c2d2e05ab","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.450Z","job_size_bytes":1751,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3ae87903fe73394ada06fc8a: start","job_status":"start","queue_duration_s":2.5833,"scheduling_latency_s":2.583326}1831gitlab # [ 260.152130] nixbot[2698]: INFO: ::ffff:127.0.0.1:35124 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1832gitlab # [ 260.157802] nixbot[2698]: INFO: ::ffff:127.0.0.1:35110 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1833gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.08 seconds)1834gitlab # [ 260.178675] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.210Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"36075e5e-63e2-4bc6-a23b-ff8885e53566\"}"],"class":"WebHookWorker","jid":"3ae87903fe73394ada06fc8a","created_at":"2026-10-06T14:50:31.445Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-bf3c4594ac72462f","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5375b8baa898758642a05cd2d1adcd26aeba313f82e205b62561a33c2d2e05ab","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:31.450Z","job_size_bytes":1751,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3ae87903fe73394ada06fc8a: done: 0.176573 sec","job_status":"done","queue_duration_s":2.5833,"scheduling_latency_s":2.583326,"redis_calls":19,"redis_duration_s":0.0045190000000000004,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001196,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000356,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001839,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.06731358299998647,"cpu_s":0.091643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527162,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.176573,"completed_at":"2026-10-06T14:50:34.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003776,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 260.236433] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.213Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"37eb57b29c5bcb6f00c6d2cb","created_at":"2026-10-06T14:50:32.178Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.182Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-37eb57b29c5bcb6f00c6d2cb: start","job_status":"start","queue_duration_s":2.030975,"scheduling_latency_s":2.030992}1836gitlab # [ 260.237272] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"37eb57b29c5bcb6f00c6d2cb","created_at":"2026-10-06T14:50:32.178Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.182Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-37eb57b29c5bcb6f00c6d2cb: done: 0.051668 sec","job_status":"done","queue_duration_s":2.030975,"scheduling_latency_s":2.030992,"redis_calls":10,"redis_duration_s":0.001543,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201702,"duration_s":0.051668,"completed_at":"2026-10-06T14:50:34.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010747,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1837gitlab # [ 260.280872] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"067bb03531abfc1c2a524d74","created_at":"2026-10-06T14:50:32.390Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.397Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-067bb03531abfc1c2a524d74: start","job_status":"start","queue_duration_s":1.868956,"scheduling_latency_s":1.868969}1838gitlab # [ 260.281695] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.288Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"067bb03531abfc1c2a524d74","created_at":"2026-10-06T14:50:32.390Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.397Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-067bb03531abfc1c2a524d74: done: 0.022097 sec","job_status":"done","queue_duration_s":1.868956,"scheduling_latency_s":1.868969,"redis_calls":10,"redis_duration_s":0.002908,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002337,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000328813,"duration_s":0.022097,"completed_at":"2026-10-06T14:50:34.288Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1839gitlab # [ 260.339309] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.289Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c780a397fe695213dd798822","created_at":"2026-10-06T14:50:32.412Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.420Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c780a397fe695213dd798822: start","job_status":"start","queue_duration_s":1.868698,"scheduling_latency_s":1.868711}1840gitlab # [ 260.339969] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c780a397fe695213dd798822","created_at":"2026-10-06T14:50:32.412Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.420Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c780a397fe695213dd798822: done: 0.019867 sec","job_status":"done","queue_duration_s":1.868698,"scheduling_latency_s":1.868711,"redis_calls":10,"redis_duration_s":0.001307,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000207568,"duration_s":0.019867,"completed_at":"2026-10-06T14:50:34.309Z","load_balancing_strategy":"primary","db_duration_s":0.002941,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1841gitlab # [ 260.363583] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1081842gitlab # [ 260.365092] gitlab-workhorse[822]: time="2026-10-06T14:50:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671843gitlab # [ 260.366641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 561844gitlab # [ 260.368986] gitaly[891]: time="2026-10-06T14:50:34.325Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3SVA5JMB32ZFMYQDDZH2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.319" grpc.time_ms=5.962 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1845gitlab # [ 260.409131] gitaly[891]: time="2026-10-06T14:50:34.386Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3SYTVGYQSAYJCYQXTSY1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.377" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1846gitlab # [ 260.410135] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.310Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"79d2784dd097a3f5c54181b5","created_at":"2026-10-06T14:50:32.437Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.444Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-79d2784dd097a3f5c54181b5: start","job_status":"start","queue_duration_s":1.865427,"scheduling_latency_s":1.865441}1847gitlab # [ 260.411515] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.346Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"79d2784dd097a3f5c54181b5","created_at":"2026-10-06T14:50:32.437Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.444Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-79d2784dd097a3f5c54181b5: done: 0.035976 sec","job_status":"done","queue_duration_s":1.865427,"scheduling_latency_s":1.865441,"redis_calls":13,"redis_duration_s":0.007659,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000966,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000437,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231314,"duration_s":0.035976,"completed_at":"2026-10-06T14:50:34.346Z","load_balancing_strategy":"primary","db_duration_s":0.005899,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848gitlab # [ 260.452918] gitlab-workhorse[822]: time="2026-10-06T14:50:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361849gitlab # [ 260.453668] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 491850gitlab # [ 260.454248] gitaly[891]: time="2026-10-06T14:50:34.386Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3SYTVGYQSAYJCYQXTSY1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.377" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1851gitlab # [ 260.459948] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.347Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e798064c49ed2bd63a60200f","created_at":"2026-10-06T14:50:32.445Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.451Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e798064c49ed2bd63a60200f: start","job_status":"start","queue_duration_s":1.896097,"scheduling_latency_s":1.896132}1852gitlab # [ 260.474942] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"e798064c49ed2bd63a60200f","created_at":"2026-10-06T14:50:32.445Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.451Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-e798064c49ed2bd63a60200f: done: 0.024747 sec","job_status":"done","queue_duration_s":1.896097,"scheduling_latency_s":1.896132,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225448,"duration_s":0.024747,"completed_at":"2026-10-06T14:50:34.372Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1853gitlab # [ 260.529586] gitaly[891]: time="2026-10-06T14:50:34.386Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3SYTVGYQSAYJCYQXTSY1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.377" grpc.time_ms=9.01 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1854gitlab # [ 260.530514] nixbot[2698]: {"ts": "2026-10-06T14:50:34.496Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1855gitlab # [ 260.531027] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0996cff2f4dee09967da7016","created_at":"2026-10-06T14:50:32.452Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.459Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0996cff2f4dee09967da7016: start","job_status":"start","queue_duration_s":1.915408,"scheduling_latency_s":1.915423}1856gitlab # [ 260.573386] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.402Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0996cff2f4dee09967da7016","created_at":"2026-10-06T14:50:32.452Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.459Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0996cff2f4dee09967da7016: done: 0.02745 sec","job_status":"done","queue_duration_s":1.915408,"scheduling_latency_s":1.915423,"redis_calls":11,"redis_duration_s":0.004099,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001019,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002046,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"duration_s":0.02745,"completed_at":"2026-10-06T14:50:34.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1857gitlab # [ 260.584285] gitaly[891]: time="2026-10-06T14:50:34.438Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T0PQD3GZPVSF482A7MD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.425" pid=891 remote_ip="2001:db8:1::1" request_sha=5addf1005e54562888a2b30809824064671312f1 response_bytes=336 span.kind=server system=grpc1858gitlab # [ 260.593204] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.403Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"29cbedd9ea23664c0e4f5973","created_at":"2026-10-06T14:50:32.464Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.469Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-29cbedd9ea23664c0e4f5973: start","job_status":"start","queue_duration_s":1.933822,"scheduling_latency_s":1.933837}1859gitlab # [ 260.645346] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.426Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"29cbedd9ea23664c0e4f5973","created_at":"2026-10-06T14:50:32.464Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.469Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-29cbedd9ea23664c0e4f5973: done: 0.023063 sec","job_status":"done","queue_duration_s":1.933822,"scheduling_latency_s":1.933837,"redis_calls":10,"redis_duration_s":0.002251,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000831391,"duration_s":0.023063,"completed_at":"2026-10-06T14:50:34.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1860gitlab # [ 260.650152] gitaly[891]: time="2026-10-06T14:50:34.438Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T0PQD3GZPVSF482A7MD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.425" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1861gitlab # [ 260.662738] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.428Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9ef9c0b5ba242da7a7f7daf0","created_at":"2026-10-06T14:50:32.471Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.476Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9ef9c0b5ba242da7a7f7daf0: start","job_status":"start","queue_duration_s":1.95161,"scheduling_latency_s":1.951625}1862gitlab # [ 260.702732] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"9ef9c0b5ba242da7a7f7daf0","created_at":"2026-10-06T14:50:32.471Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.476Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9ef9c0b5ba242da7a7f7daf0: done: 0.041684 sec","job_status":"done","queue_duration_s":1.95161,"scheduling_latency_s":1.951625,"redis_calls":10,"redis_duration_s":0.001689,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001045,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229917,"duration_s":0.041684,"completed_at":"2026-10-06T14:50:34.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 260.716635] nixbot[2698]: {"ts": "2026-10-06T14:50:34.667Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1864gitlab # [ 260.718754] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1601865gitlab # [ 260.721163] gitaly[891]: time="2026-10-06T14:50:34.438Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1193 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T0PQD3GZPVSF482A7MD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:34.425" grpc.time_ms=12.919 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1866gitlab # [ 260.765757] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.471Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"172ed422750b60edd37c20fc","created_at":"2026-10-06T14:50:32.484Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.488Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-172ed422750b60edd37c20fc: start","job_status":"start","queue_duration_s":1.982581,"scheduling_latency_s":1.982597}1867gitlab # [ 260.766592] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.499Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"172ed422750b60edd37c20fc","created_at":"2026-10-06T14:50:32.484Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.488Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-172ed422750b60edd37c20fc: done: 0.028396 sec","job_status":"done","queue_duration_s":1.982581,"scheduling_latency_s":1.982597,"redis_calls":10,"redis_duration_s":0.002091,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000321,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000613,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212318,"duration_s":0.028396,"completed_at":"2026-10-06T14:50:34.499Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007151,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1868gitlab # [ 260.807663] gitaly[891]: time="2026-10-06T14:50:34.556Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.554" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.555" grpc.time_ms=0.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab # [ 260.808460] nixbot[2698]: {"ts": "2026-10-06T14:50:34.827Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1870gitlab # [ 260.808940] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"45eb7e0b1efa21e1b9dc69db","created_at":"2026-10-06T14:50:32.489Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.493Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-45eb7e0b1efa21e1b9dc69db: start","job_status":"start","queue_duration_s":2.007349,"scheduling_latency_s":2.007364}1871gitlab # [ 260.852615] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"45eb7e0b1efa21e1b9dc69db","created_at":"2026-10-06T14:50:32.489Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.493Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-45eb7e0b1efa21e1b9dc69db: done: 0.021552 sec","job_status":"done","queue_duration_s":2.007349,"scheduling_latency_s":2.007364,"redis_calls":10,"redis_duration_s":0.0021809999999999998,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000344,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025115,"duration_s":0.021552,"completed_at":"2026-10-06T14:50:34.522Z","load_balancing_strategy":"primary","db_duration_s":0.002981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 260.854568] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1561873gitlab # [ 260.856715] gitaly[891]: time="2026-10-06T14:50:34.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=10 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.614" grpc.time_ms=13.013 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874gitlab # [ 260.869687] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"62666a5864c2bceb3b354a4d","created_at":"2026-10-06T14:50:32.494Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.500Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-62666a5864c2bceb3b354a4d: start","job_status":"start","queue_duration_s":2.022695,"scheduling_latency_s":2.022709}1875gitlab # [ 260.883112] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"62666a5864c2bceb3b354a4d","created_at":"2026-10-06T14:50:32.494Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.500Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-62666a5864c2bceb3b354a4d: done: 0.025776 sec","job_status":"done","queue_duration_s":2.022695,"scheduling_latency_s":2.022709,"redis_calls":10,"redis_duration_s":0.001459,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212876,"duration_s":0.025776,"completed_at":"2026-10-06T14:50:34.549Z","load_balancing_strategy":"primary","db_duration_s":0.005426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1876gitlab # [ 260.929703] gitaly[891]: time="2026-10-06T14:50:34.644Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 diskcache=f736bd00-bd6f-444f-9ec8-cb8f8777dbda grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:34.633" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.633" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 260.930494] gitaly[891]: time="2026-10-06T14:50:34.645Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-06T20:50:34.633" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.633" grpc.time_ms=11.276 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 260.971693] nixbot[2698]: {"ts": "2026-10-06T14:50:34.942Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc \"HTTP/1.1 201 Created\""}1879gitlab # [ 260.972515] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.550Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"880696eaa0cb58418df7ee42","created_at":"2026-10-06T14:50:32.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.516Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-880696eaa0cb58418df7ee42: start","job_status":"start","queue_duration_s":2.03349,"scheduling_latency_s":2.033504}1880gitlab # [ 260.973713] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.593Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"880696eaa0cb58418df7ee42","created_at":"2026-10-06T14:50:32.509Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.516Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-880696eaa0cb58418df7ee42: done: 0.042885 sec","job_status":"done","queue_duration_s":2.03349,"scheduling_latency_s":2.033504,"redis_calls":14,"redis_duration_s":0.002164,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000336,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000245282,"duration_s":0.042885,"completed_at":"2026-10-06T14:50:34.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 261.030022] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/a19aff1adb0d9b72e397bc88315b31884feb66bc HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1091882gitlab # [ 261.030680] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421883gitlab # [ 261.031564] gitlab-workhorse[822]: time="2026-10-06T14:50:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671884gitlab # [ 261.031983] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 451885gitlab # [ 261.032623] gitaly[891]: time="2026-10-06T14:50:34.675Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.674" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.674" grpc.time_ms=0.797 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 261.033767] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.594Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"37080f07e54c69ed79ca632b","created_at":"2026-10-06T14:50:32.625Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.627Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-37080f07e54c69ed79ca632b: start","job_status":"start","queue_duration_s":1.967171,"scheduling_latency_s":1.967187}1887gitlab # [ 261.034553] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.614Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"37080f07e54c69ed79ca632b","created_at":"2026-10-06T14:50:32.625Z","trace_propagation_headers":{"sentry-trace":"75451c5f4c39412fbbc488e6a0370b9f-a59590efb6214eb1","baggage":"sentry-trace_id=75451c5f4c39412fbbc488e6a0370b9f,sentry-release=Unknown"},"correlation_id":"01M48V2ANDD32WNJXBXCKEM5NV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.627Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-37080f07e54c69ed79ca632b: done: 0.020844 sec","job_status":"done","queue_duration_s":1.967171,"scheduling_latency_s":1.967187,"redis_calls":8,"redis_duration_s":0.002404,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001912,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020844,"completed_at":"2026-10-06T14:50:34.614Z","load_balancing_strategy":"primary","db_duration_s":0.002763,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1888gitlab # [ 261.069326] gitaly[891]: time="2026-10-06T14:50:34.684Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:50:44.216" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.677" grpc.time_ms=6.856 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 261.081089] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.616Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f71db12a4db0698d18f4762c","created_at":"2026-10-06T14:50:32.773Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e97128485d2542f767e86501","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.774Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f71db12a4db0698d18f4762c: start","job_status":"start","queue_duration_s":1.841464,"scheduling_latency_s":1.84148}1890gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1891gitlab # [ 261.123199] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.658Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f71db12a4db0698d18f4762c","created_at":"2026-10-06T14:50:32.773Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e97128485d2542f767e86501","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.774Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f71db12a4db0698d18f4762c: done: 0.041696 sec","job_status":"done","queue_duration_s":1.841464,"scheduling_latency_s":1.84148,"gitaly_calls":1,"gitaly_duration_s":0.01378,"redis_calls":12,"redis_duration_s":0.003432,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000542,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001654,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.027231674,"duration_s":0.041696,"completed_at":"2026-10-06T14:50:34.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1892gitlab # [ 261.137230] gitaly[891]: time="2026-10-06T14:50:34.706Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:04.705" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.705" grpc.time_ms=0.617 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 261.148891] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:34.659Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fdb680241ca58f224bbbf26f","created_at":"2026-10-06T14:50:32.927Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:806c4a71afcb410a561b535532b46149a5281635f0dd3739cdb36af1c808450f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.929Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fdb680241ca58f224bbbf26f: start","job_status":"start","queue_duration_s":1.730283,"scheduling_latency_s":1.730299}1894gitlab # [ 261.201480] sidekiq-cluster[2584]: {"severity":"WARN","time":"2026-10-06T14:50:35.148Z","class":"CreatePipelineWorker","correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"a19aff1adb0d9b72e397bc88315b31884feb66bc","after":"1ff64674a261f25f1aea4f39330a7ad87ce52348","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1ff64674a261f25f1aea4f39330a7ad87ce52348","ref":"refs/heads/master"},"retry":0}1895gitlab # [ 261.202306] gitaly[891]: time="2026-10-06T14:50:34.710Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=196 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-06T14:51:04.708" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.708" grpc.time_ms=1.958 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.06 seconds)1897gitlab # [ 261.203273] nixbot[2698]: INFO: ::ffff:127.0.0.1:35128 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1898gitlab # [ 261.203715] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"fdb680241ca58f224bbbf26f","created_at":"2026-10-06T14:50:32.927Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:806c4a71afcb410a561b535532b46149a5281635f0dd3739cdb36af1c808450f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.929Z","job_size_bytes":467,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-fdb680241ca58f224bbbf26f: done: 0.492882 sec","job_status":"done","queue_duration_s":1.730283,"scheduling_latency_s":1.730299,"gitaly_calls":7,"gitaly_duration_s":0.074679,"redis_calls":33,"redis_duration_s":0.005322,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000436,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003435,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.399262,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.492882,"completed_at":"2026-10-06T14:50:35.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01162,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1899gitlab # [ 261.227895] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.153Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"838901e6-d173-473d-952d-87f991c87673\"}"],"class":"WebHookWorker","jid":"04805f4c7e8dd624b4824e34","created_at":"2026-10-06T14:50:32.943Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d326489c3829b92da45fb096e5e6d941c691ea48433b642b060cf5da1757085a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.947Z","job_size_bytes":1749,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-04805f4c7e8dd624b4824e34: start","job_status":"start","queue_duration_s":2.206402,"scheduling_latency_s":2.20642}1900gitlab # [ 261.243799] gitaly[891]: time="2026-10-06T14:50:34.740Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.272" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.733" grpc.time_ms=6.66 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 261.284651] nixbot[2698]: INFO: ::ffff:127.0.0.1:35138 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1902gitlab # [ 261.285514] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.182Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"838901e6-d173-473d-952d-87f991c87673\"}"],"class":"WebHookWorker","jid":"04805f4c7e8dd624b4824e34","created_at":"2026-10-06T14:50:32.943Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-08eb8629b3db4711","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d326489c3829b92da45fb096e5e6d941c691ea48433b642b060cf5da1757085a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:32.947Z","job_size_bytes":1749,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-04805f4c7e8dd624b4824e34: done: 0.028882 sec","job_status":"done","queue_duration_s":2.206402,"scheduling_latency_s":2.20642,"redis_calls":14,"redis_duration_s":0.001811,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000261,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0057219560000021374,"cpu_s":0.01768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.028882,"completed_at":"2026-10-06T14:50:35.182Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1903gitlab # [ 261.299252] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.183Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8c6ddf41e71a2d4bc6f3a183","created_at":"2026-10-06T14:50:33.098Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-8b54a1aad91e4f56","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:33.104Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8c6ddf41e71a2d4bc6f3a183: start","job_status":"start","queue_duration_s":2.07915,"scheduling_latency_s":2.079173}1904gitlab # [ 261.313738] gitaly[891]: time="2026-10-06T14:50:34.740Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T9EQR4VMDSEENJH9BTD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.738" grpc.time_ms=1.572 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 261.359139] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 901906gitlab # [ 261.359875] gitlab-workhorse[822]: time="2026-10-06T14:50:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671907gitlab # [ 261.360493] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 511908gitlab # [ 261.361000] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"8c6ddf41e71a2d4bc6f3a183","created_at":"2026-10-06T14:50:33.098Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-8b54a1aad91e4f56","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:33.104Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-8c6ddf41e71a2d4bc6f3a183: done: 0.03561 sec","job_status":"done","queue_duration_s":2.07915,"scheduling_latency_s":2.079173,"redis_calls":19,"redis_duration_s":0.003551,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001117,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000487,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000552,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006224813,"duration_s":0.03561,"completed_at":"2026-10-06T14:50:35.219Z","load_balancing_strategy":"primary","db_duration_s":0.005188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1909gitlab # [ 261.370703] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.221Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3ae87903fe73394ada06fc8a"],"class":"WebHooks::LogExecutionWorker","jid":"347dd3b1b395ad96eda21f93","created_at":"2026-10-06T14:50:34.194Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-5d44e6637c33462e","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c79aa03b4dc473464c6f7af101f0763acbd452329e458734ce3f8d9d0a389aca","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.201Z","job_size_bytes":2593,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-347dd3b1b395ad96eda21f93: start","job_status":"start","queue_duration_s":1.019451,"scheduling_latency_s":1.019466}1910gitlab # [ 261.420237] gitaly[891]: time="2026-10-06T14:50:34.783Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3T9EQR4VMDSEENJH9BTD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.777" grpc.time_ms=5.583 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 261.421303] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 401912gitlab # [ 261.421821] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.253Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3ae87903fe73394ada06fc8a"],"class":"WebHooks::LogExecutionWorker","jid":"347dd3b1b395ad96eda21f93","created_at":"2026-10-06T14:50:34.194Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-5d44e6637c33462e","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c79aa03b4dc473464c6f7af101f0763acbd452329e458734ce3f8d9d0a389aca","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.201Z","job_size_bytes":2593,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-347dd3b1b395ad96eda21f93: done: 0.032052 sec","job_status":"done","queue_duration_s":1.019451,"scheduling_latency_s":1.019466,"redis_calls":10,"redis_duration_s":0.00138,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212596,"duration_s":0.032052,"completed_at":"2026-10-06T14:50:35.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1913gitlab # [ 261.469117] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.254Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"935594e855117f9b82a61220","created_at":"2026-10-06T14:50:34.653Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-f3816d2e40c34205","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.656Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-935594e855117f9b82a61220: start","job_status":"start","queue_duration_s":0.597933,"scheduling_latency_s":0.597947}1914gitlab # [ 261.470610] gitaly[891]: time="2026-10-06T14:50:34.868Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TEFZAQG7BCCJZBBXJFQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:04.867" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:34.867" grpc.time_ms=0.585 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1915gitlab # [ 261.471544] gitlab-workhorse[822]: time="2026-10-06T14:50:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161916gitlab # [ 261.472050] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 561917gitlab # [ 261.472586] gitaly[891]: time="2026-10-06T14:50:34.896Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3TEFZAQG7BCCJZBBXJFQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:44.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:34.889" grpc.time_ms=7.459 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918gitlab # [ 261.482123] gitaly[891]: time="2026-10-06T14:50:35.008Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3TJP9RGZGM018SRM5Z93 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=200 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.001" grpc.time_ms=7.384 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 261.494833] gitaly[891]: time="2026-10-06T14:50:35.055Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TM3S5Q468F21R6H07Q9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.048" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1920gitlab # [ 261.504556] gitaly[891]: time="2026-10-06T14:50:35.055Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TM3S5Q468F21R6H07Q9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.048" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1921gitlab # [ 261.545609] gitaly[891]: time="2026-10-06T14:50:35.055Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TM3S5Q468F21R6H07Q9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.048" grpc.time_ms=6.843 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1922gitlab # [ 261.546582] gitaly[891]: time="2026-10-06T14:50:35.106Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=958 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=9 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-06T14:51:05.092" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.092" grpc.time_ms=13.237 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 261.546754] gitaly[891]: time="2026-10-06T14:50:35.138Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=20 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V3KWXXJAZF3HMB5WQVRG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-06T14:51:05.109" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.109" grpc.time_ms=29.381 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1924gitlab # [ 261.588734] gitaly[891]: time="2026-10-06T14:50:35.282Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=53 command.spawn_token_fork_ms=47 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V3TSQZQ09V40TMRW2S37S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.227" grpc.time_ms=54.493 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925gitlab # [ 261.589620] gitaly[891]: time="2026-10-06T14:50:35.335Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TWM9DWS3YBAR8QRPGR6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.327" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1926gitlab # [ 261.591215] gitaly[891]: time="2026-10-06T14:50:35.335Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TWM9DWS3YBAR8QRPGR6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.327" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927gitlab # [ 261.591953] gitaly[891]: time="2026-10-06T14:50:35.335Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3TWM9DWS3YBAR8QRPGR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.327" grpc.time_ms=7.975 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928gitlab # [ 261.604542] gitaly[891]: time="2026-10-06T14:50:35.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V031WFXHJSYEQF69Q16 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.428" grpc.time_ms=6.624 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929gitlab # [ 261.616533] gitaly[891]: time="2026-10-06T14:50:35.476Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.475" grpc.time_ms=0.346 pid=891 span.kind=server system=grpc1930gitlab # [ 261.625278] gitaly[891]: time="2026-10-06T14:50:35.492Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V1D18V8Z7R19E0J2RES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.479" pid=891 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1931gitlab # [ 261.634959] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.651Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"935594e855117f9b82a61220","created_at":"2026-10-06T14:50:34.653Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-f3816d2e40c34205","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.656Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2584,"job_status":"rescheduled","message":"PipelineProcessWorker JID-935594e855117f9b82a61220: rescheduled"}1932gitlab # [ 261.684645] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.658Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"935594e855117f9b82a61220","created_at":"2026-10-06T14:50:34.653Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-f3816d2e40c34205","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:34.656Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-935594e855117f9b82a61220: done: 0.404635 sec","job_status":"done","queue_duration_s":0.597933,"scheduling_latency_s":0.597947,"gitaly_calls":3,"gitaly_duration_s":0.195656,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011141999999999999,"redis_read_bytes":148,"redis_write_bytes":18016,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000513,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000746,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002857,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12315,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.003671,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00017,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000771,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.101,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097864,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.376975006,"duration_s":0.404635,"completed_at":"2026-10-06T14:50:35.658Z","load_balancing_strategy":"primary","db_duration_s":0.102938,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1933gitlab # [ 261.731856] gitaly[891]: time="2026-10-06T14:50:35.493Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V1D18V8Z7R19E0J2RES grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.479" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1934gitlab # [ 261.732843] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.661Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","04805f4c7e8dd624b4824e34"],"class":"WebHooks::LogExecutionWorker","jid":"425d9a9e8e68c14446e59e00","created_at":"2026-10-06T14:50:35.175Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-4d3db99fd4414152","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d603780844b1bde0e6d272d3a88b0c5a0d92b2c3ae09515a725be47b22d82f59","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.177Z","job_size_bytes":2592,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-425d9a9e8e68c14446e59e00: start","job_status":"start","queue_duration_s":0.483865,"scheduling_latency_s":0.483889}1935gitlab # [ 261.733412] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.682Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","04805f4c7e8dd624b4824e34"],"class":"WebHooks::LogExecutionWorker","jid":"425d9a9e8e68c14446e59e00","created_at":"2026-10-06T14:50:35.175Z","trace_propagation_headers":{"sentry-trace":"3dde4c92c55743b59bbdfaf45cce63f5-4d3db99fd4414152","baggage":"sentry-trace_id=3dde4c92c55743b59bbdfaf45cce63f5,sentry-release=Unknown"},"correlation_id":"01M48V3KWXXJAZF3HMB5WQVRG8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d603780844b1bde0e6d272d3a88b0c5a0d92b2c3ae09515a725be47b22d82f59","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.177Z","job_size_bytes":2592,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-425d9a9e8e68c14446e59e00: done: 0.021363 sec","job_status":"done","queue_duration_s":0.483865,"scheduling_latency_s":0.483889,"redis_calls":7,"redis_duration_s":0.001352,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000871,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021363,"completed_at":"2026-10-06T14:50:35.682Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1936gitlab # [ 261.796882] gitaly[891]: time="2026-10-06T14:50:35.493Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1171 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V1D18V8Z7R19E0J2RES grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:35.479" grpc.time_ms=13.655 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 261.797639] nixbot[2698]: {"ts": "2026-10-06T14:50:35.775Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""}1938gitlab # [ 261.798147] nixbot[2698]: {"ts": "2026-10-06T14:50:35.782Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1ff64674a261-5"}1939gitlab # [ 261.798655] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"10943e5e8832967fb3df5cfc","created_at":"2026-10-06T14:50:35.208Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-879261acc7e74f11","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.212Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-10943e5e8832967fb3df5cfc: start","job_status":"start","queue_duration_s":0.471185,"scheduling_latency_s":0.471207}1940gitlab # [ 261.799436] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.752Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"10943e5e8832967fb3df5cfc","created_at":"2026-10-06T14:50:35.208Z","trace_propagation_headers":{"sentry-trace":"9755dc43009441b9b547c4d3eea150bf-879261acc7e74f11","baggage":"sentry-trace_id=9755dc43009441b9b547c4d3eea150bf,sentry-release=Unknown"},"correlation_id":"01M48V25WSJYRJM7HDTYWFNKXD","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.212Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-10943e5e8832967fb3df5cfc: done: 0.06842 sec","job_status":"done","queue_duration_s":0.471185,"scheduling_latency_s":0.471207,"redis_calls":11,"redis_duration_s":0.001826,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000301,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227962,"duration_s":0.06842,"completed_at":"2026-10-06T14:50:35.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015955,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1941gitlab # [ 261.850908] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2501942gitlab # [ 261.851644] gitaly[891]: time="2026-10-06T14:50:35.501Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.500" grpc.time_ms=0.542 pid=891 span.kind=server system=grpc1943gitlab # [ 261.852512] gitaly[891]: time="2026-10-06T14:50:35.561Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.561" grpc.time_ms=0.28 pid=891 span.kind=server system=grpc1944gitlab # [ 261.857562] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97f388bbd6f2da6332d49f5c","created_at":"2026-10-06T14:50:35.374Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.377Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97f388bbd6f2da6332d49f5c: start","job_status":"start","queue_duration_s":0.376444,"scheduling_latency_s":0.376459}1945gitlab # [ 261.872727] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.788Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"97f388bbd6f2da6332d49f5c","created_at":"2026-10-06T14:50:35.374Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.377Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-97f388bbd6f2da6332d49f5c: done: 0.035313 sec","job_status":"done","queue_duration_s":0.376444,"scheduling_latency_s":0.376459,"redis_calls":7,"redis_duration_s":0.004631000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035313,"completed_at":"2026-10-06T14:50:35.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006368,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1946gitlab # [ 261.917585] nixbot[2698]: {"ts": "2026-10-06T14:50:35.878Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1ff64674a261-5", "argv0": "bwrap"}1947gitlab # [ 261.918396] gitaly[891]: time="2026-10-06T14:50:35.563Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:05.561" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.561" grpc.time_ms=1.262 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 261.960611] gitaly[891]: time="2026-10-06T14:50:35.572Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP diskcache=449a35e1-4d27-42af-b881-385676f3c330 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:05.383" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.383" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 261.961529] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.789Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0194d6b845983b2b40bcb3b5","created_at":"2026-10-06T14:50:35.577Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.579Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0194d6b845983b2b40bcb3b5: start","job_status":"start","queue_duration_s":0.209927,"scheduling_latency_s":0.209942}1950gitlab # [ 261.962223] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.806Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0194d6b845983b2b40bcb3b5","created_at":"2026-10-06T14:50:35.577Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.579Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0194d6b845983b2b40bcb3b5: done: 0.017012 sec","job_status":"done","queue_duration_s":0.209927,"scheduling_latency_s":0.209942,"redis_calls":7,"redis_duration_s":0.001422,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000853,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017012,"completed_at":"2026-10-06T14:50:35.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1951gitlab # [ 262.004853] gitaly[891]: time="2026-10-06T14:50:35.572Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7404 command.oublock=0 command.real_time_ms=180 command.spawn_token_fork_ms=47 command.system_time_ms=45 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:05.383" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.383" grpc.time_ms=188.579 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 262.006128] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"27ab5f0be01baa5fa6c5736d","created_at":"2026-10-06T14:50:35.588Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.590Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-27ab5f0be01baa5fa6c5736d: start","job_status":"start","queue_duration_s":0.217338,"scheduling_latency_s":0.217353}1953gitlab # [ 262.013491] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.825Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"27ab5f0be01baa5fa6c5736d","created_at":"2026-10-06T14:50:35.588Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.590Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-27ab5f0be01baa5fa6c5736d: done: 0.017129 sec","job_status":"done","queue_duration_s":0.217338,"scheduling_latency_s":0.217353,"redis_calls":7,"redis_duration_s":0.001034,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017129,"completed_at":"2026-10-06T14:50:35.825Z","load_balancing_strategy":"primary","db_duration_s":0.002722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1954gitlab # [ 262.064807] gitaly[891]: time="2026-10-06T14:50:35.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-06T14:51:05.569" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.570" grpc.time_ms=9.128 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 262.065889] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"73d495d01835806d5f5a231a","created_at":"2026-10-06T14:50:35.597Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.598Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-73d495d01835806d5f5a231a: start","job_status":"start","queue_duration_s":0.227627,"scheduling_latency_s":0.227641}1956gitlab # [ 262.077181] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.846Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"73d495d01835806d5f5a231a","created_at":"2026-10-06T14:50:35.597Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.598Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-73d495d01835806d5f5a231a: done: 0.02001 sec","job_status":"done","queue_duration_s":0.227627,"scheduling_latency_s":0.227641,"redis_calls":10,"redis_duration_s":0.001391,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000407,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02001,"completed_at":"2026-10-06T14:50:35.846Z","load_balancing_strategy":"primary","db_duration_s":0.004343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1957gitlab # [ 262.116643] gitaly[891]: time="2026-10-06T14:50:35.592Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:45.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.585" grpc.time_ms=6.51 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 262.127826] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2240421d5cefc8c64e23e482","created_at":"2026-10-06T14:50:35.598Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.599Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2240421d5cefc8c64e23e482: start","job_status":"start","queue_duration_s":0.247483,"scheduling_latency_s":0.247496}1959gitlab # [ 262.143538] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.863Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"2240421d5cefc8c64e23e482","created_at":"2026-10-06T14:50:35.598Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.599Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-2240421d5cefc8c64e23e482: done: 0.016222 sec","job_status":"done","queue_duration_s":0.247483,"scheduling_latency_s":0.247496,"redis_calls":7,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016222,"completed_at":"2026-10-06T14:50:35.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348'1961gitlab # [ 262.189389] gitaly[891]: time="2026-10-06T14:50:35.609Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-06T14:50:45.028" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:35.608" grpc.time_ms=0.183 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 262.191313] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.865Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7e9a52c5160818f6f865cdf","created_at":"2026-10-06T14:50:35.600Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.601Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7e9a52c5160818f6f865cdf: start","job_status":"start","queue_duration_s":0.263903,"scheduling_latency_s":0.263948}1963gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348', in 0.04 seconds)1964(finished: subtest: push delivers the webhook, in 52.08 seconds)1965subtest: eval and build post commit statuses1966gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses1967gitlab # [ 262.233130] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"a7e9a52c5160818f6f865cdf","created_at":"2026-10-06T14:50:35.600Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.601Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-a7e9a52c5160818f6f865cdf: done: 0.046598 sec","job_status":"done","queue_duration_s":0.263903,"scheduling_latency_s":0.263948,"redis_calls":8,"redis_duration_s":0.023811,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.023524,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046598,"completed_at":"2026-10-06T14:50:35.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1968gitlab # [ 262.278202] gitaly[891]: time="2026-10-06T14:50:35.616Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-06T14:50:45.000" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:35.611" grpc.time_ms=5.199 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 262.279259] nixbot[2698]: INFO: ::ffff:127.0.0.1:35142 - "GET /api/repos/gitlab/root/test-flake/builds?commit=1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 200 OK1970gitlab # [ 262.279984] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.913Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a58941ce43c3a722884009b5","created_at":"2026-10-06T14:50:35.602Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.604Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a58941ce43c3a722884009b5: start","job_status":"start","queue_duration_s":0.308243,"scheduling_latency_s":0.308267}1971gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.08 seconds)1972gitlab # [ 262.280627] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.929Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"a58941ce43c3a722884009b5","created_at":"2026-10-06T14:50:35.602Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.604Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-a58941ce43c3a722884009b5: done: 0.016502 sec","job_status":"done","queue_duration_s":0.308243,"scheduling_latency_s":0.308267,"redis_calls":7,"redis_duration_s":0.000975,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000667,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016502,"completed_at":"2026-10-06T14:50:35.929Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973gitlab # [ 262.326555] nix-daemon[2873]: accepted connection from pid 3697, user nixbot1974gitlab # [ 262.327305] gitaly[891]: time="2026-10-06T14:50:35.620Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:05.619" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.619" grpc.time_ms=0.632 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975gitlab # [ 262.328111] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.930Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6c0ed10f294aff1a31bf4dbf","created_at":"2026-10-06T14:50:35.605Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.606Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6c0ed10f294aff1a31bf4dbf: start","job_status":"start","queue_duration_s":0.324211,"scheduling_latency_s":0.324225}1976gitlab # [ 262.368713] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.947Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6c0ed10f294aff1a31bf4dbf","created_at":"2026-10-06T14:50:35.605Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.606Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6c0ed10f294aff1a31bf4dbf: done: 0.017155 sec","job_status":"done","queue_duration_s":0.324211,"scheduling_latency_s":0.324225,"redis_calls":7,"redis_duration_s":0.0009220000000000001,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017155,"completed_at":"2026-10-06T14:50:35.947Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 262.376444] gitaly[891]: time="2026-10-06T14:50:35.644Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3T4AGKMJNJT8MXWF7VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:05.642" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.643" grpc.time_ms=1.343 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 262.387715] gitaly[891]: time="2026-10-06T14:50:35.655Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.653" grpc.time_ms=2.162 pid=891 span.kind=server system=grpc1979gitlab # [ 262.428307] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 571980gitlab # [ 262.429048] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.948Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2a6f9ea0ed637c06ba9cc15a","created_at":"2026-10-06T14:50:35.606Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.608Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2a6f9ea0ed637c06ba9cc15a: start","job_status":"start","queue_duration_s":0.3406,"scheduling_latency_s":0.340614}1981gitlab # [ 262.429690] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.958Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"2a6f9ea0ed637c06ba9cc15a","created_at":"2026-10-06T14:50:35.606Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.608Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-2a6f9ea0ed637c06ba9cc15a: done: 0.009361 sec","job_status":"done","queue_duration_s":0.3406,"scheduling_latency_s":0.340614,"redis_calls":7,"redis_duration_s":0.001043,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000253,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009361,"completed_at":"2026-10-06T14:50:35.957Z","load_balancing_strategy":"primary","db_duration_s":0.000763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1982gitlab # [ 262.470872] gitaly[891]: time="2026-10-06T14:50:35.701Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:35.701" grpc.time_ms=0.353 pid=891 span.kind=server system=grpc1983gitlab # [ 262.471586] gitaly[891]: time="2026-10-06T14:50:35.712Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT diskcache=4ecc5918-ff73-45c0-985e-586f53bcee74 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:35.618" pid=891 ref=refs/keep-around/1ff64674a261f25f1aea4f39330a7ad87ce52348 remote_ip="2001:db8:1::1" revision=1ff64674a261f25f1aea4f39330a7ad87ce52348 span.kind=server system=grpc username=root1984gitlab # [ 262.472241] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8d7c9ade68bb8018ff64e906","created_at":"2026-10-06T14:50:35.608Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.609Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8d7c9ade68bb8018ff64e906: start","job_status":"start","queue_duration_s":0.349634,"scheduling_latency_s":0.349648}1985gitlab # [ 262.512361] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.973Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"8d7c9ade68bb8018ff64e906","created_at":"2026-10-06T14:50:35.608Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.609Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-8d7c9ade68bb8018ff64e906: done: 0.013753 sec","job_status":"done","queue_duration_s":0.349634,"scheduling_latency_s":0.349648,"redis_calls":7,"redis_duration_s":0.0009519999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013753,"completed_at":"2026-10-06T14:50:35.973Z","load_balancing_strategy":"primary","db_duration_s":0.002049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 262.552959] gitaly[891]: time="2026-10-06T14:50:35.712Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=45 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5085 command.oublock=8 command.real_time_ms=85 command.spawn_token_fork_ms=0 command.system_time_ms=31 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-06T14:50:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-06T14:50:35.618" grpc.time_ms=94.284 pid=891 ref=refs/keep-around/1ff64674a261f25f1aea4f39330a7ad87ce52348 remote_ip="2001:db8:1::1" revision=1ff64674a261f25f1aea4f39330a7ad87ce52348 span.kind=server system=grpc username=root1987gitlab # [ 262.553694] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.974Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3edd66defa0f5bd39c1ef902","created_at":"2026-10-06T14:50:35.652Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.653Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3edd66defa0f5bd39c1ef902: start","job_status":"start","queue_duration_s":0.320523,"scheduling_latency_s":0.320536}1988gitlab # [ 262.554522] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.989Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"3edd66defa0f5bd39c1ef902","created_at":"2026-10-06T14:50:35.652Z","trace_propagation_headers":{"sentry-trace":"47df15cd856a4a53829ba725a7b0672d-9e298fb5dc9c4250","baggage":"sentry-trace_id=47df15cd856a4a53829ba725a7b0672d,sentry-release=Unknown"},"correlation_id":"01M48V3T4AGKMJNJT8MXWF7VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.653Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3edd66defa0f5bd39c1ef902: done: 0.015095 sec","job_status":"done","queue_duration_s":0.320523,"scheduling_latency_s":0.320536,"redis_calls":8,"redis_duration_s":0.001046,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000246,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015095,"completed_at":"2026-10-06T14:50:35.989Z","load_balancing_strategy":"primary","db_duration_s":0.002015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1989gitlab # [ 262.597774] gitaly[891]: time="2026-10-06T14:50:35.716Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:05.715" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:35.715" grpc.time_ms=0.687 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 262.598635] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:35.990Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c18c76027f81d28a560f6722","created_at":"2026-10-06T14:50:35.718Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.721Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c18c76027f81d28a560f6722: start","job_status":"start","queue_duration_s":0.268641,"scheduling_latency_s":0.268654}1991gitlab # [ 262.636936] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.007Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"c18c76027f81d28a560f6722","created_at":"2026-10-06T14:50:35.718Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.721Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-c18c76027f81d28a560f6722: done: 0.017729 sec","job_status":"done","queue_duration_s":0.268641,"scheduling_latency_s":0.268654,"redis_calls":7,"redis_duration_s":0.001098,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017729,"completed_at":"2026-10-06T14:50:36.007Z","load_balancing_strategy":"primary","db_duration_s":0.003234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1992gitlab # [ 262.682251] gitaly[891]: time="2026-10-06T14:50:36.104Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:06.103" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:36.103" grpc.time_ms=1.072 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 262.682993] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.008Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6532193feb780337e894d95c","created_at":"2026-10-06T14:50:35.721Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.723Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6532193feb780337e894d95c: start","job_status":"start","queue_duration_s":0.285673,"scheduling_latency_s":0.285688}1994gitlab # [ 262.683590] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.045Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6532193feb780337e894d95c","created_at":"2026-10-06T14:50:35.721Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.723Z","job_size_bytes":65,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6532193feb780337e894d95c: done: 0.036892 sec","job_status":"done","queue_duration_s":0.285673,"scheduling_latency_s":0.285688,"redis_calls":10,"redis_duration_s":0.002025,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036892,"completed_at":"2026-10-06T14:50:36.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 262.722144] gitaly[891]: time="2026-10-06T14:50:36.132Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3V44S8AK5PWWC7P2JHMT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:06.131" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:36.132" grpc.time_ms=0.604 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 262.724708] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.046Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a06e6ce276664c4c111c1d4f","created_at":"2026-10-06T14:50:35.760Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.762Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a06e6ce276664c4c111c1d4f: start","job_status":"start","queue_duration_s":0.284566,"scheduling_latency_s":0.284589}1997gitlab # [ 262.739627] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.144Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"a06e6ce276664c4c111c1d4f","created_at":"2026-10-06T14:50:35.760Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-719f98d1d0844a66","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:35.762Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a06e6ce276664c4c111c1d4f: done: 0.097313 sec","job_status":"done","queue_duration_s":0.284566,"scheduling_latency_s":0.284589,"gitaly_calls":2,"gitaly_duration_s":0.006349,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.004795,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000659,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000776,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00022,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001212,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000172,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000284,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064475,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06959432,"duration_s":0.097313,"completed_at":"2026-10-06T14:50:36.144Z","load_balancing_strategy":"primary","db_duration_s":0.025202,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1998gitlab # [ 262.821219] gitaly[891]: time="2026-10-06T14:50:36.353Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3VWVCYRZZ1HMSFEYW01Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:06.152" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:36.352" grpc.time_ms=0.495 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 262.821904] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"79fe3675868ca03541cb3d05","created_at":"2026-10-06T14:50:36.089Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-0df7d481b39946bc","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:36.090Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-79fe3675868ca03541cb3d05: start","job_status":"start","queue_duration_s":0.054733,"scheduling_latency_s":0.054755}2000gitlab # [ 262.822540] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:36.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"79fe3675868ca03541cb3d05","created_at":"2026-10-06T14:50:36.089Z","trace_propagation_headers":{"sentry-trace":"c855c6d8e3ea4b19825adada348d288e-0df7d481b39946bc","baggage":"sentry-trace_id=c855c6d8e3ea4b19825adada348d288e,sentry-release=Unknown"},"correlation_id":"01M48V3V44S8AK5PWWC7P2JHMT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:36.090Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-79fe3675868ca03541cb3d05: done: 0.024304 sec","job_status":"done","queue_duration_s":0.054733,"scheduling_latency_s":0.054755,"redis_calls":7,"redis_duration_s":0.001027,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024304,"completed_at":"2026-10-06T14:50:36.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00466,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2001gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses2002gitlab # [ 263.461528] gitaly[891]: time="2026-10-06T14:50:37.493Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3WZH8HVERE328ED4CARV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:07.491" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:37.491" grpc.time_ms=1.179 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003gitlab # [ 263.536071] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1412004gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.20 seconds)2005gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses2006gitlab # [ 264.645330] gitaly[891]: time="2026-10-06T14:50:38.676Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3Y4KTJP2S0Q8GT427101 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:08.474" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:38.674" grpc.time_ms=0.97 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 264.682689] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1012008gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.15 seconds)2009gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses2010gitlab # [ 265.790314] gitaly[891]: time="2026-10-06T14:50:39.821Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V3Z8F5B1V5D5228C53MSJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:09.619" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:39.820" grpc.time_ms=1.053 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011gitlab # [ 265.827186] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 982012gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.14 seconds)2013gitlab # [ 266.671409] nix-daemon[2873]: accepted connection from pid 3735, user nixbot2014gitlab # [ 266.688561] nix-daemon[2873]: accepted connection from pid 3697, user nixbot2015gitlab # [ 266.801448] gitaly[891]: time="2026-10-06T14:50:40.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:10.830" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:40.831" grpc.time_ms=1.021 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses2017gitlab # [ 266.863525] gitaly[891]: time="2026-10-06T14:50:40.895Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:50.275" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:40.885" grpc.time_ms=9.242 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2018gitlab # [ 266.941188] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:40.970Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5433ac301a945f0f104c65a8","created_at":"2026-10-06T14:50:40.963Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-172109a8ece84f1c","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:40.968Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5433ac301a945f0f104c65a8: start","job_status":"start","queue_duration_s":0.002204,"scheduling_latency_s":0.002258}2019gitlab # [ 266.981104] gitaly[891]: time="2026-10-06T14:50:41.012Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V40CXBFVBDF5X09KYF5P1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.010" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.010" grpc.time_ms=0.905 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 266.990556] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2582021gitlab # [ 266.993884] nixbot[2698]: {"ts": "2026-10-06T14:50:41.022Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""}2022gitlab # [ 267.040106] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 1462023gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.21 seconds)2024gitlab # [ 267.096659] gitaly[891]: time="2026-10-06T14:50:41.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V40G125CYFX449SM424SC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.127" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.127" grpc.time_ms=0.549 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 267.128569] gitaly[891]: time="2026-10-06T14:50:41.160Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.160" grpc.time_ms=0.29 pid=891 span.kind=server system=grpc2026gitlab # [ 267.129613] gitaly[891]: time="2026-10-06T14:50:41.161Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V40G125CYFX449SM424SC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:51.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.153" grpc.time_ms=7.328 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027gitlab # [ 267.171662] gitaly[891]: time="2026-10-06T14:50:41.203Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.203" grpc.time_ms=0.281 pid=891 span.kind=server system=grpc2028gitlab # [ 267.182077] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1872029gitlab # [ 267.184499] nixbot[2698]: {"ts": "2026-10-06T14:50:41.214Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""}2030gitlab # [ 267.202077] gitaly[891]: time="2026-10-06T14:50:41.233Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.233" grpc.time_ms=0.235 pid=891 span.kind=server system=grpc2031gitlab # [ 267.214262] gitaly[891]: time="2026-10-06T14:50:41.246Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" operations="[repack_refs]" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2032gitlab # [ 267.221914] gitaly[891]: time="2026-10-06T14:50:41.253Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD diskcache=7cfa896c-370b-468f-90a1-b5fa7f3eb1a0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 267.222731] gitaly[891]: time="2026-10-06T14:50:41.254Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=127 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7443 command.oublock=0 command.real_time_ms=130 command.spawn_token_fork_ms=0 command.system_time_ms=91 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" grpc.time_ms=138.725 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2034gitlab # [ 267.234405] gitaly[891]: time="2026-10-06T14:50:41.266Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V40PAQ836QA3A39A9VZYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.265" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.265" grpc.time_ms=0.502 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2035gitlab # [ 267.258677] gitaly[891]: time="2026-10-06T14:50:41.290Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-06 14:49:34.245222624 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2036gitlab # [ 267.275525] gitaly[891]: time="2026-10-06T14:50:41.307Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2037gitlab # [ 267.287924] gitaly[891]: time="2026-10-06T14:50:41.307Z" level=info msg="optimized repository" clean_stale_data_time=16.464663ms clean_work_trees_time="74.591µs" commit_graph_time="3.911µs" correlation_id=01M48V407T78E7CK8XB9QV2SWD gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.912µs" pid=891 prune_time="3.073µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=16.650161ms2038gitlab # [ 267.293889] gitaly[891]: time="2026-10-06T14:50:41.307Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.114" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.115" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039gitlab # [ 267.294542] gitaly[891]: time="2026-10-06T14:50:41.310Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M48V40PAQ836QA3A39A9VZYX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-06T14:50:51.154" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.304" grpc.time_ms=5.926 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2040gitlab # [ 267.295222] gitaly[891]: time="2026-10-06T14:50:41.313Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-06T14:51:11.311" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.311" grpc.time_ms=1.119 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 267.313858] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1182042gitlab # [ 267.314827] nixbot[2698]: {"ts": "2026-10-06T14:50:41.346Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1ff64674a261f25f1aea4f39330a7ad87ce52348 \"HTTP/1.1 201 Created\""}2043gitlab # [ 267.344364] gitaly[891]: time="2026-10-06T14:50:41.376Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-06T14:51:11.375" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-06T14:50:41.375" grpc.time_ms=0.514 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2044gitlab # [ 267.364117] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.395Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"54c65f180805929549050ce0","created_at":"2026-10-06T14:50:41.394Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"5433ac301a945f0f104c65a8","job_size_bytes":3,"pid":2584,"job_status":"deduplicated","message":"PipelineProcessWorker JID-54c65f180805929549050ce0: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2045gitlab # [ 267.365809] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.397Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5433ac301a945f0f104c65a8","created_at":"2026-10-06T14:50:40.963Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-172109a8ece84f1c","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:40.968Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2584,"job_status":"rescheduled","message":"PipelineProcessWorker JID-5433ac301a945f0f104c65a8: rescheduled"}2046gitlab # [ 267.371425] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.402Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"5433ac301a945f0f104c65a8","created_at":"2026-10-06T14:50:40.963Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-172109a8ece84f1c","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:40.968Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5433ac301a945f0f104c65a8: done: 0.432491 sec","job_status":"done","queue_duration_s":0.002204,"scheduling_latency_s":0.002258,"gitaly_calls":3,"gitaly_duration_s":0.146906,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.051248,"redis_read_bytes":239,"redis_write_bytes":21787,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000957,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.010863,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.009508,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14472,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.026532,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000258,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000456,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120626,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.330404004,"duration_s":0.432491,"completed_at":"2026-10-06T14:50:41.402Z","load_balancing_strategy":"primary","db_duration_s":0.084713,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2047gitlab # [ 267.415886] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e8b2a4f78c1e8bbb50c643ea","created_at":"2026-10-06T14:50:41.107Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.109Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e8b2a4f78c1e8bbb50c643ea: start","job_status":"start","queue_duration_s":0.297595,"scheduling_latency_s":0.297629}2048gitlab # [ 267.416660] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.445Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e8b2a4f78c1e8bbb50c643ea","created_at":"2026-10-06T14:50:41.107Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.109Z","job_size_bytes":23,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e8b2a4f78c1e8bbb50c643ea: done: 0.038242 sec","job_status":"done","queue_duration_s":0.297595,"scheduling_latency_s":0.297629,"redis_calls":7,"redis_duration_s":0.001107,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038242,"completed_at":"2026-10-06T14:50:41.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014302,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2049gitlab # [ 267.462696] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.446Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"008317c5e63142fb1658a916","created_at":"2026-10-06T14:50:41.259Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.261Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-008317c5e63142fb1658a916: start","job_status":"start","queue_duration_s":0.185578,"scheduling_latency_s":0.185593}2050gitlab # [ 267.466936] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.466Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"008317c5e63142fb1658a916","created_at":"2026-10-06T14:50:41.259Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.261Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-008317c5e63142fb1658a916: done: 0.020277 sec","job_status":"done","queue_duration_s":0.185578,"scheduling_latency_s":0.185593,"redis_calls":7,"redis_duration_s":0.0025859999999999998,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020277,"completed_at":"2026-10-06T14:50:41.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 267.510635] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8ecde3c7cb12ff704ac468ca","created_at":"2026-10-06T14:50:41.267Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.272Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8ecde3c7cb12ff704ac468ca: start","job_status":"start","queue_duration_s":0.196104,"scheduling_latency_s":0.196117}2052gitlab # [ 267.555668] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8ecde3c7cb12ff704ac468ca","created_at":"2026-10-06T14:50:41.267Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.272Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8ecde3c7cb12ff704ac468ca: done: 0.023697 sec","job_status":"done","queue_duration_s":0.196104,"scheduling_latency_s":0.196117,"redis_calls":7,"redis_duration_s":0.0046630000000000005,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00299,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001673,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023697,"completed_at":"2026-10-06T14:50:41.491Z","load_balancing_strategy":"primary","db_duration_s":0.004579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 267.599101] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"37695ebd2d96522977e37c55","created_at":"2026-10-06T14:50:41.278Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.280Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-37695ebd2d96522977e37c55: start","job_status":"start","queue_duration_s":0.212824,"scheduling_latency_s":0.212848}2054gitlab # [ 267.599868] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.523Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"37695ebd2d96522977e37c55","created_at":"2026-10-06T14:50:41.278Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.280Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-37695ebd2d96522977e37c55: done: 0.030559 sec","job_status":"done","queue_duration_s":0.212824,"scheduling_latency_s":0.212848,"redis_calls":10,"redis_duration_s":0.004889999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000417,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030559,"completed_at":"2026-10-06T14:50:41.523Z","load_balancing_strategy":"primary","db_duration_s":0.004999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 267.652769] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3847edffa95da1ad57740656","created_at":"2026-10-06T14:50:41.280Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.281Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3847edffa95da1ad57740656: start","job_status":"start","queue_duration_s":0.243041,"scheduling_latency_s":0.24309}2056gitlab # [ 267.653425] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.548Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3847edffa95da1ad57740656","created_at":"2026-10-06T14:50:41.280Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.281Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3847edffa95da1ad57740656: done: 0.023814 sec","job_status":"done","queue_duration_s":0.243041,"scheduling_latency_s":0.24309,"redis_calls":7,"redis_duration_s":0.004894,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004533,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023814,"completed_at":"2026-10-06T14:50:41.548Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2057gitlab # [ 267.702724] gitaly[891]: time="2026-10-06T14:50:41.662Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V412DW2A4X17FH6C1C8JH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.656" grpc.time_ms=5.789 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2058gitlab # [ 267.703422] gitaly[891]: time="2026-10-06T14:50:41.711Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V413ZGYRJNPSFMARR3JFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.705" pid=891 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2059gitlab # [ 267.703772] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 482060gitlab # [ 267.704390] gitlab-workhorse[822]: time="2026-10-06T14:50:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672061gitlab # [ 267.704875] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 482062gitlab # [ 267.706542] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.549Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8032c112912ac90775178ea0","created_at":"2026-10-06T14:50:41.282Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.283Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8032c112912ac90775178ea0: start","job_status":"start","queue_duration_s":0.266226,"scheduling_latency_s":0.266244}2063gitlab # [ 267.715574] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.567Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8032c112912ac90775178ea0","created_at":"2026-10-06T14:50:41.282Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.283Z","job_size_bytes":19,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8032c112912ac90775178ea0: done: 0.017306 sec","job_status":"done","queue_duration_s":0.266226,"scheduling_latency_s":0.266244,"redis_calls":8,"redis_duration_s":0.001464,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001182,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017306,"completed_at":"2026-10-06T14:50:41.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2064gitlab # [ 267.759156] gitaly[891]: time="2026-10-06T14:50:41.711Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V413ZGYRJNPSFMARR3JFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.705" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 267.765531] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.568Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"70ac5d7cce3feff83b86470f","created_at":"2026-10-06T14:50:41.289Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.290Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-70ac5d7cce3feff83b86470f: start","job_status":"start","queue_duration_s":0.277483,"scheduling_latency_s":0.277499}2066gitlab # [ 267.808783] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.584Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"70ac5d7cce3feff83b86470f","created_at":"2026-10-06T14:50:41.289Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.290Z","job_size_bytes":66,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-70ac5d7cce3feff83b86470f: done: 0.01591 sec","job_status":"done","queue_duration_s":0.277483,"scheduling_latency_s":0.277499,"redis_calls":7,"redis_duration_s":0.001854,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01591,"completed_at":"2026-10-06T14:50:41.584Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 267.858646] gitaly[891]: time="2026-10-06T14:50:41.711Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M48V413ZGYRJNPSFMARR3JFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.705" grpc.time_ms=6.626 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2068gitlab # [ 267.859581] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 722069gitlab # [ 267.860299] gitlab-workhorse[822]: time="2026-10-06T14:50:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672070gitlab # [ 267.860964] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/06:14:50:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 562071gitlab # [ 267.861806] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.585Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"22f40fd9943a3f919776b534","created_at":"2026-10-06T14:50:41.292Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.293Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-22f40fd9943a3f919776b534: start","job_status":"start","queue_duration_s":0.292319,"scheduling_latency_s":0.292338}2072gitlab # [ 267.862453] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.646Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"22f40fd9943a3f919776b534","created_at":"2026-10-06T14:50:41.292Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.293Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-22f40fd9943a3f919776b534: done: 0.061473 sec","job_status":"done","queue_duration_s":0.292319,"scheduling_latency_s":0.292338,"redis_calls":7,"redis_duration_s":0.002236,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061473,"completed_at":"2026-10-06T14:50:41.646Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2073gitlab # [ 267.910371] gitaly[891]: time="2026-10-06T14:50:41.788Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.787" grpc.time_ms=0.338 pid=891 span.kind=server system=grpc2074gitlab # [ 267.911122] gitaly[891]: time="2026-10-06T14:50:41.808Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.807" grpc.time_ms=0.238 pid=891 span.kind=server system=grpc2075gitlab # [ 267.912932] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.648Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"dd75789bc7eee93dd915f8a5","created_at":"2026-10-06T14:50:41.296Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.297Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-dd75789bc7eee93dd915f8a5: start","job_status":"start","queue_duration_s":0.35043,"scheduling_latency_s":0.350479}2076gitlab # [ 267.961520] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.668Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"dd75789bc7eee93dd915f8a5","created_at":"2026-10-06T14:50:41.296Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.297Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-dd75789bc7eee93dd915f8a5: done: 0.020486 sec","job_status":"done","queue_duration_s":0.35043,"scheduling_latency_s":0.350479,"redis_calls":7,"redis_duration_s":0.0009989999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020486,"completed_at":"2026-10-06T14:50:41.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005028,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2077gitlab # [ 267.968525] gitaly[891]: time="2026-10-06T14:50:41.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M48V416AC4YDWNFVRB3AF6K0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.799" grpc.time_ms=10.449 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc2078gitlab # [ 268.013894] gitaly[891]: time="2026-10-06T14:50:41.828Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-06T14:50:41.827" grpc.time_ms=0.446 pid=891 span.kind=server system=grpc2079gitlab # [ 268.014738] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.669Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c7d438fe6466c96f6178838c","created_at":"2026-10-06T14:50:41.297Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.299Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c7d438fe6466c96f6178838c: start","job_status":"start","queue_duration_s":0.369965,"scheduling_latency_s":0.369978}2080gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses2081gitlab # [ 268.015555] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c7d438fe6466c96f6178838c","created_at":"2026-10-06T14:50:41.297Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.299Z","job_size_bytes":6,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c7d438fe6466c96f6178838c: done: 0.008657 sec","job_status":"done","queue_duration_s":0.369965,"scheduling_latency_s":0.369978,"redis_calls":7,"redis_duration_s":0.000889,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008657,"completed_at":"2026-10-06T14:50:41.677Z","load_balancing_strategy":"primary","db_duration_s":0.000346,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2082gitlab # [ 268.063072] gitaly[891]: time="2026-10-06T14:50:41.838Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD diskcache=ccae2b26-566c-40e2-a969-d8711bb445c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.766" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.766" pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 268.063776] gitaly[891]: time="2026-10-06T14:50:41.839Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=64 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7259 command.oublock=0 command.real_time_ms=65 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M48V407T78E7CK8XB9QV2SWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-06T14:51:11.766" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-06T14:50:41.766" grpc.time_ms=72.345 pid=891 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 268.064377] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"1487f5151cc78b2f5d617cc5","created_at":"2026-10-06T14:50:41.299Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.300Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1487f5151cc78b2f5d617cc5: start","job_status":"start","queue_duration_s":0.378188,"scheduling_latency_s":0.378202}2085gitlab # [ 268.104089] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"1487f5151cc78b2f5d617cc5","created_at":"2026-10-06T14:50:41.299Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.300Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1487f5151cc78b2f5d617cc5: done: 0.024763 sec","job_status":"done","queue_duration_s":0.378188,"scheduling_latency_s":0.378202,"redis_calls":7,"redis_duration_s":0.0010249999999999999,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024763,"completed_at":"2026-10-06T14:50:41.703Z","load_balancing_strategy":"primary","db_duration_s":0.006218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2086gitlab # [ 268.143788] gitaly[891]: time="2026-10-06T14:50:41.868Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M48V418MC122FE7NMPJBK82V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-06T14:50:41.860" pid=891 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2087gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/1ff64674a261f25f1aea4f39330a7ad87ce52348/statuses, in 0.13 seconds)2088gitlab # [ 268.144680] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.705Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"9ac17bd50037dc7c40e9b6aa","created_at":"2026-10-06T14:50:41.398Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.399Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ac17bd50037dc7c40e9b6aa: start","job_status":"start","queue_duration_s":0.30554,"scheduling_latency_s":0.305558}2089(finished: subtest: eval and build post commit statuses, in 5.91 seconds)2090(finished: run the VM test script, in 317.98 seconds)2091test script finished in 318.00s2092cleanup2093kill QemuMachine (pid 46)2094gitlab # [ 268.145483] sidekiq-cluster[2584]: {"severity":"INFO","time":"2026-10-06T14:50:41.917Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"9ac17bd50037dc7c40e9b6aa","created_at":"2026-10-06T14:50:41.398Z","trace_propagation_headers":{"sentry-trace":"80bac178b979447b8da4bb582b698aea-079b0d6a68ec4610","baggage":"sentry-trace_id=80bac178b979447b8da4bb582b698aea,sentry-release=Unknown"},"correlation_id":"01M48V407T78E7CK8XB9QV2SWD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-06T14:50:41.399Z","job_size_bytes":3,"pid":2584,"sidekiq_tid":"m824","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9ac17bd50037dc7c40e9b6aa: done: 0.212174 sec","job_status":"done","queue_duration_s":0.30554,"scheduling_latency_s":0.305558,"gitaly_calls":3,"gitaly_duration_s":0.07937,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016067,"redis_read_bytes":144,"redis_write_bytes":16877,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.002146,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001076,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.002857,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.005674,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000174,qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2095(finished: cleanup, in 1.92 seconds)2096additionally exposed symbols:2097 gitlab,2098 vlan1,2099 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2100[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-06T14:49:43.897Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2101[]2102[]2103[]2104[]2105[]2106[]2107[]2108[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-10-06T14:50:35.517763Z', 'started_at': '2026-10-06T14:50:35.780262Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2109[{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2110[{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2111[{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2112[{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2113[{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': '2026-10-06T14:50:40.950Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2114[{'id': 5, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-10-06T14:50:35.755Z', 'started_at': None, 'finished_at': '2026-10-06T14:50:40.950Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '1ff64674a261f25f1aea4f39330a7ad87ce52348', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-06T14:50:41.194Z', 'started_at': None, 'finished_at': '2026-10-06T14:50:41.328Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]