vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #403
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.MnOOgfWxCD', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15gitlab # Filesystem UUID: 10b9410f-0786-42ed-853d-e537f1106f4c16gitlab # Superblock backups stored on blocks:17gitlab # 32768, 98304, 163840, 22937618gitlab # 19gitlab # Allocating group tables: 0/8 done20(finished: start all VMs, in 49.72 seconds)21gitlab # Writing inode tables: 0/8 done22gitlab # Creating journal (8192 blocks): done23gitlab: waiting for unit setup-gitlab.service24gitlab # Writing superblocks and filesystem accounting information: 0/8 done25gitlab: waiting for the VM to finish booting26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3h8465lmn1hnkg3xpdhy0z4xn2dfr79a-nixos-system-gitlab-test/init regInfo=/nix/store/jd99kli3dhw113w0ibflpa2r0i69sv15-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 493061207 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000804] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000831] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000834] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000873] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002785] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002798] Using GB pages for direct mapping73gitlab # [ 0.002906] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002919] ACPI: Early table checksum verification disabled75gitlab # [ 0.002922] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002926] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002930] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002937] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002939] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002941] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002942] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002944] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002945] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002946] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002947] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002947] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002948] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002948] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003191] No NUMA configuration found90gitlab # [ 0.003192] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003194] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.006191] Zone ranges:93gitlab # [ 0.006192] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.006193] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.006195] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.006196] Device empty97gitlab # [ 0.006197] Movable zone start for each node98gitlab # [ 0.006197] Early memory node ranges99gitlab # [ 0.006198] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.006199] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.006200] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.006201] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.006222] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.006504] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.122008] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.122451] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.122466] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.122502] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.122505] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.122507] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.122508] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.122510] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.122510] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.122513] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.122514] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.122519] TSC deadline timer available117gitlab # [ 0.122524] CPU topo: Max. logical packages: 1118gitlab # [ 0.122525] CPU topo: Max. logical dies: 1119gitlab # [ 0.122525] CPU topo: Max. dies per package: 1120gitlab # [ 0.122528] CPU topo: Max. threads per core: 1121gitlab # [ 0.122529] CPU topo: Num. cores per package: 4122gitlab # [ 0.122529] CPU topo: Num. threads per package: 4123gitlab # [ 0.122530] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.122556] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.122574] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.122577] kvm-guest: setup PV sched yield127gitlab # [ 0.122592] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.122594] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.122595] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.122597] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.122599] Booting paravirtualized kernel on KVM132gitlab # [ 0.122602] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.127063] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.129401] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.129453] kvm-guest: PV spinlocks enabled136gitlab # [ 0.129454] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.129457] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3h8465lmn1hnkg3xpdhy0z4xn2dfr79a-nixos-system-gitlab-test/init regInfo=/nix/store/jd99kli3dhw113w0ibflpa2r0i69sv15-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.129557] Unknown kernel command line parameters "regInfo=/nix/store/jd99kli3dhw113w0ibflpa2r0i69sv15-closure-info/registration", will be passed to user space.139gitlab # [ 0.129569] random: crng init done140gitlab # [ 0.129570] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.139069] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.143990] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.144067] software IO TLB: area num 4.144gitlab # [ 0.223766] Fallback order for Node 0: 0145gitlab # [ 0.223779] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.223782] Policy zone: Normal147gitlab # [ 0.226359] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.238132] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.251948] allocated 12582912 bytes of page_ext150gitlab # [ 0.265941] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.265943] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.266890] Dynamic Preempt: lazy153gitlab # [ 0.267091] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.267092] rcu: RCU event tracing is enabled.155gitlab # [ 0.267093] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.267096] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.267096] Rude variant of Tasks RCU enabled.158gitlab # [ 0.267097] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.267097] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.267098] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.267130] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.267132] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.267133] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.271683] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.271987] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.271996] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.272108] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.275692] Console: colour VGA+ 80x25169gitlab # [ 0.275695] printk: legacy console [tty0] enabled170gitlab # [ 0.306563] printk: legacy console [ttyS0] enabled171gitlab # [ 0.415633] ACPI: Core revision 20250807172gitlab # [ 0.416571] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.418204] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.419245] x2apic enabled175gitlab # [ 0.420021] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.420994] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.422273] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.423773] kvm-guest: setup PV IPIs179gitlab # [ 0.425368] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.426439] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.428261] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.429350] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.430406] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.432257] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.433263] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.434258] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.435258] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.437071] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.438258] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.439258] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.440267] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.441258] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.442258] active return thunk: srso_alias_return_thunk194gitlab # [ 0.443981] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.445257] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.446256] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.447257] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.448257] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.449257] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.450258] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.452258] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.453257] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.454257] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.455257] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.456257] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.457257] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.491484] Freeing SMP alternatives memory: 44K208gitlab # [ 0.492261] pid_max: default: 32768 minimum: 301209gitlab # [ 0.493261] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.494387] landlock: Up and running.211gitlab # [ 0.495049] Yama: becoming mindful.212gitlab # [ 0.495973] LSM support for eBPF active213gitlab # [ 0.496496] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.498403] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.501005] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.501813] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.502263] ... version: 2218gitlab # [ 0.503031] ... bit width: 48219gitlab # [ 0.503260] ... generic counters: 6220gitlab # [ 0.504059] ... generic bitmap: 000000000000003f221gitlab # [ 0.505055] ... fixed-purpose counters: 0222gitlab # [ 0.505260] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.506214] ... value mask: 0000ffffffffffff224gitlab # [ 0.507010] ... max period: 00007fffffffffff225gitlab # [ 0.507260] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.508363] signal: max sigframe size: 3376227gitlab # [ 0.509224] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.509898] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.510449] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.516036] smp: Bringing up secondary CPUs ...231gitlab # [ 0.516653] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.517268] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.520368] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.522260] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.523600] Memory: 6011356K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.525261] devtmpfs: initialized237gitlab # [ 0.526315] x86/mm: Memory block size: 128MB238gitlab # [ 0.529450] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.531377] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.532381] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.533533] PM: RTC time: 16:52:26, date: 2026-10-02242gitlab # [ 0.537373] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.539712] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.540339] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.542902] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.544275] audit: initializing netlink subsys (disabled)247gitlab # [ 0.545330] audit: type=2000 audit(1790959946.276:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.545604] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.547261] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.548261] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.549260] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.550261] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.551279] cpuidle: using governor menu254gitlab # [ 0.553538] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.554585] PCI: Using configuration type 1 for base access256gitlab # [ 0.555261] PCI: Using configuration type 1 for extended access257gitlab # [ 0.556422] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.558608] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.559262] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.560265] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.561261] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.566206] ACPI: Added _OSI(Module Device)263gitlab # [ 0.568267] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.570266] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.577243] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.584540] ACPI: Interpreter enabled267gitlab # [ 0.585296] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.586049] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.586293] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.587261] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.588561] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.602396] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.605277] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.610278] acpiphp: Slot [3] registered275gitlab # [ 0.611405] acpiphp: Slot [4] registered276gitlab # [ 0.613434] acpiphp: Slot [5] registered277gitlab # [ 0.615373] acpiphp: Slot [6] registered278gitlab # [ 0.617361] acpiphp: Slot [7] registered279gitlab # [ 0.619386] acpiphp: Slot [8] registered280gitlab # [ 0.621351] acpiphp: Slot [9] registered281gitlab # [ 0.622358] acpiphp: Slot [10] registered282gitlab # [ 0.624359] acpiphp: Slot [11] registered283gitlab # [ 0.626371] acpiphp: Slot [12] registered284gitlab # [ 0.627333] acpiphp: Slot [13] registered285gitlab # [ 0.629302] acpiphp: Slot [14] registered286gitlab # [ 0.630324] acpiphp: Slot [15] registered287gitlab # [ 0.631305] acpiphp: Slot [16] registered288gitlab # [ 0.633304] acpiphp: Slot [17] registered289gitlab # [ 0.634302] acpiphp: Slot [18] registered290gitlab # [ 0.636333] acpiphp: Slot [19] registered291gitlab # [ 0.637304] acpiphp: Slot [20] registered292gitlab # [ 0.639302] acpiphp: Slot [21] registered293gitlab # [ 0.640303] acpiphp: Slot [22] registered294gitlab # [ 0.642323] acpiphp: Slot [23] registered295gitlab # [ 0.643280] acpiphp: Slot [24] registered296gitlab # [ 0.644005] acpiphp: Slot [25] registered297gitlab # [ 0.644279] acpiphp: Slot [26] registered298gitlab # [ 0.645056] acpiphp: Slot [27] registered299gitlab # [ 0.646281] acpiphp: Slot [28] registered300gitlab # [ 0.647009] acpiphp: Slot [29] registered301gitlab # [ 0.647295] acpiphp: Slot [30] registered302gitlab # [ 0.648052] acpiphp: Slot [31] registered303gitlab # [ 0.649275] PCI host bridge to bus 0000:00304gitlab # [ 0.649997] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.651268] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.652260] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.653277] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.654262] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.656275] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.657902] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.662720] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.667396] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.674356] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.677334] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.679266] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.682265] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.685267] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.688733] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.694944] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.699406] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.702806] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.705276] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.708758] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.728375] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.729277] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.730309] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.732828] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.735126] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.740297] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.741231] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.742285] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.755268] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.757917] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.762296] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.763239] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.765081] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.767536] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.772297] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.773246] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.774085] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.776550] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.782261] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.783198] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.784082] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.786494] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.790296] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.791220] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.793282] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.796256] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.803824] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.807287] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.809339] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.817113] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.828301] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.830282] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.833322] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.836281] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.841469] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.849317] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.852322] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.858106] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.865295] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.867284] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.870321] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.876671] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.886303] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.889282] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.891322] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.903779] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.906671] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.909617] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.912591] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.914462] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.920636] iommu: Default domain type: Translated375gitlab # [ 0.922266] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.924596] ACPI: bus type USB registered377gitlab # [ 0.926378] usbcore: registered new interface driver usbfs378gitlab # [ 0.927278] usbcore: registered new interface driver hub379gitlab # [ 0.928281] usbcore: registered new device driver usb380gitlab # [ 0.930804] NetLabel: Initializing381gitlab # [ 0.931261] NetLabel: domain hash size = 128382gitlab # [ 0.932052] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.933103] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.934033] PCI: Using ACPI for IRQ routing385gitlab # [ 0.935703] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.936256] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.936256] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.938264] vgaarb: loaded389gitlab # [ 0.939077] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.939930] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.945351] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.950341] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.951102] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.952753] pnp: PnP ACPI init395gitlab # [ 0.953990] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.963773] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.965401] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.966481] NET: Registered PF_INET protocol family399gitlab # [ 0.968729] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.989496] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.991434] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.993336] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.998360] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 1.000343] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 1.001915] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 1.003777] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 1.005294] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 1.007118] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 1.008253] NET: Registered PF_XDP protocol family410gitlab # [ 1.009320] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 1.010533] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 1.011918] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 1.013381] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 1.014780] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 1.016500] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 1.017606] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 1.020196] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 1.023111] PCI: CLS 0 bytes, default 64419gitlab # [ 1.023986] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 1.024692] Trying to unpack rootfs image as initramfs...421gitlab # [ 1.025129] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 1.028050] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.049489] Initialise system trusted keyrings424gitlab # [ 1.050796] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.062754] Key type asymmetric registered426gitlab # [ 1.063517] Asymmetric key parser 'x509' registered427gitlab # [ 1.064481] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.066152] io scheduler mq-deadline registered429gitlab # [ 1.067025] io scheduler kyber registered430gitlab # [ 1.071803] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.073221] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.075901] Linux agpgart interface v0.103433gitlab # [ 1.076745] ACPI: bus type drm_connector registered434gitlab # [ 1.079804] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.081070] usbserial: USB Serial support registered for generic436gitlab # [ 1.082134] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.082134] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.084581] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.086063] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.087421] NET: Registered PF_INET6 protocol family441gitlab # [ 1.089350] Segment Routing with IPv6442gitlab # [ 1.090074] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.092592] IPI shorthand broadcast: enabled444gitlab # [ 1.097304] sched_clock: Marking stable (949016559, 148260749)->(1124640797, -27363489)445gitlab # [ 1.099377] registered taskstats version 1446gitlab # [ 1.100557] Loading compiled-in X.509 certificates447gitlab # [ 1.111209] Demotion targets for Node 0: null448gitlab # [ 1.112599] Key type .fscrypt registered449gitlab # [ 1.114435] Key type fscrypt-provisioning registered450gitlab # [ 1.116908] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.119422] ima: Allocated hash algorithm: sha1452gitlab # [ 1.121508] ima: No architecture policies found453gitlab # [ 1.125864] PM: Magic number: 14:211:893454gitlab # [ 1.130435] RAS: Correctable Errors collector initialized.455gitlab # [ 1.141985] clk: Disabling unused clocks456gitlab # [ 1.143901] PM: genpd: Disabling unused power domains457gitlab # [ 1.328919] Freeing initrd memory: 29392K458gitlab # [ 1.336332] Freeing unused decrypted memory: 2028K459gitlab # [ 1.342902] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.345723] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.350821] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.354872] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.423881] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.425153] Run /init as init process465gitlab # [ 1.438892] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.462061] fuse: init (API version 7.45)467gitlab # [ 1.470780] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.478158] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.481601] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.523086] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.860151] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.901944] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.904237] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.906460] systemd[1]: Running in initrd.475gitlab # [ 1.908960] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.912065] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 2.026128] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.064469] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.076091] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.077984] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.079518] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.080756] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.081908] systemd[1]: Reached target Path Units.484gitlab # [ 2.082818] systemd[1]: Reached target Slice Units.485gitlab # [ 2.083709] systemd[1]: Reached target Swaps.486gitlab # [ 2.084557] systemd[1]: Reached target Timer Units.487gitlab # [ 2.085616] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.086860] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.088063] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.089105] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.090178] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.091174] systemd[1]: Reached target Socket Units.493gitlab # [ 2.093328] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.095619] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.097590] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.100340] systemd[1]: Starting Journal Service...497gitlab # [ 2.104352] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.106429] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.113345] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.117527] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.119419] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.122329] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.123760] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config504gitlab # [ 2.130394] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...505gitlab # [ 2.133590] systemd-journald[91]: Collecting audit messages is disabled.506gitlab # [ 2.137738] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.139998] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev508gitlab # [ 2.147844] systemd[1]: Finished Load Kernel Modules.509gitlab # [ 2.154690] systemd[1]: Starting Apply Kernel Variables...510gitlab # [ 2.159346] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.511gitlab # [ 2.161465] netfs: FS-Cache loaded512gitlab # [ 2.161761] systemd[1]: Starting Create Static Device Nodes in /dev...513gitlab # [ 2.168897] 9pnet: Installing 9P2000 support514gitlab # [ 2.175739] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.177599] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 2.030181] systemd-modules-load[93]: Using 4 probe threads517gitlab # [ 2.031817] systemd-modules-l[ 2.180046] systemd[1]: Started Journal Service.518gitlab # oad[93]: Inserted module 'virtio_balloon'519gitlab # [ 2.033533] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 2.034679] systemd-modules-load[93]: Inserted module 'dm_mod'521gitlab # [ 2.037102] systemd[1]: Finished Apply Kernel Variables.522gitlab # [ 2.038082] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 2.040882] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 2.041932] systemd[1]: Reached target Local File Systems.525gitlab # [ 2.042739] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 2.043734] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.056803] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.066440] systemd-udevd[111]: Using default interface naming scheme 'v261'.529gitlab # [ 2.076951] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.098625] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.099689] systemd[1]: Reached target System Initialization.532gitlab # [ 2.100502] systemd[1]: Reached target Basic System.533gitlab # [ 2.355422] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.356494] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.357670] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.359397] virtio_blk virtio4: 4/0/0 default/read/poll queues537gitlab # [ 2.361027] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.362666] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.364014] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.365016] SCSI subsystem initialized541gitlab # [ 2.365173] usb usb1: Product: UHCI Host Controller542gitlab # [ 2.366803] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd543gitlab # [ 2.367766] usb usb1: SerialNumber: 0000:00:01.2544gitlab # [ 2.374220] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12545gitlab # [ 2.377510] serio: i8042 KBD port at 0x60,0x64 irq 1546gitlab # [ 2.378140] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)547gitlab # [ 2.378381] serio: i8042 AUX port at 0x60,0x64 irq 12548gitlab # [ 2.384735] hub 1-0:1.0: USB hub found549gitlab # [ 2.385468] hub 1-0:1.0: 2 ports detected550gitlab # [ 2.386610] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.390768] virtio_blk virtio5: [vdb] 11843808 512-byte logical blocks (6.06 GB/5.65 GiB)552gitlab # [ 2.284561] systemd[1]: Starting Virtual Console Setup...553gitlab # [ 2.290625] (udev-worker)[135]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to dev[ 2.438689] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0554gitlab # ice based on potentially unpredictable interface name.555gitlab # [ 2.297498] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.556gitlab # [ 2.299069] (udev-worker)[135]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.306591] systemd[1]: Found device /dev/disk/by-label/nixos.[ 2.455688] scsi host0: ata_piix558gitlab # 559gitlab # [ 2.308643] systemd[1]: Reached target Initrd Root Device.560gitlab # [ 2.309728] s[ 2.457827] scsi host1: ata_piix561gitlab # ystemd-vconsole-setup[141]: Configuration of first virtual console was skipped, ignoring remaining ones.[ 2.458717] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0562gitlab # 563gitlab # [ 2.461024] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0564gitlab # [ 2.313347] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...565gitlab # [ 2.315540] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.324455] systemd[1]: Found device /dev/disk/by-label/nix-store.567gitlab # [ 2.335172] systemd-fsck[158]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.338782] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.604624] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.620062] ata2: found unknown device (class 0)571gitlab # [ 2.622945] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100572gitlab # [ 2.627602] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5573gitlab # [ 2.684812] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.712026] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.774110] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.777330] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.780023] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.782221] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.783932] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.817159] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.830733] usbcore: registered new interface driver usbhid582gitlab # [ 2.833097] usbhid: USB HID core driver583gitlab # [ 2.842906] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.846377] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.972815] systemd[1]: Mounting /sysroot...586gitlab # [ 3.279616] EXT4-fs (vda): mounted filesystem 10b9410f-0786-42ed-853d-e537f1106f4c r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.139065] systemd[1]: Mounted /sysroot.588gitlab # [ 3.141539] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.146909] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.150678] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.158993] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.164169] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.168190] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.172754] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.182284] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.334747] 9p: Installing v9fs 9p2000 file system support597gitlab # [ 3.335632] erofs (device vdb): mounted with root inode @ nid 128.598gitlab # [ 3.190976] systemd[1]: Starting rw-sysroot-nix-store.service...599gitlab # [ 3.195275] systemd[1]: Mounted /sysroot/nix/.ro-store.600gitlab # [ 3.196865] systemd[1]: Mounted /sysroot/run.601gitlab # [ 3.198359] systemd[1]: Mounted /sysroot/tmp/shared.602gitlab # [ 3.199717] systemd[1]: Mounted /sysroot/tmp/xchg.603gitlab # [ 3.205402] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.604gitlab # [ 3.206525] systemd[1]: Finished rw-sysroot-nix-store.service.605gitlab # [ 3.209475] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.606gitlab # [ 3.210960] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...607gitlab # [ 3.212495] systemd[1]: Reloading...608gitlab # [ 3.271762] systemd[1]: Reloading finished in 60 ms.609gitlab # [ 3.295634] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...610gitlab # [ 3.298601] systemd[1]: Starting rw-sysroot-nix-store.service...611gitlab # [ 3.300649] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...612gitlab # [ 3.304957] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.309099] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.311666] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.315132] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.317680] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.973259] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 4.026273] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 4.028656] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 4.030884] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.033440] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.058589] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.061536] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.081246] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.083196] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.085685] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.128627] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.130994] systemd[1]: Stopped target Basic System.629gitlab # [ 4.133126] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.135222] systemd[1]: Stopped target Path Units.631gitlab # [ 4.137326] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.142618] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.147887] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.149975] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.152363] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.155320] systemd[1]: Stopped target Swaps.637gitlab # [ 4.157270] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.159340] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.161642] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.163927] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.166761] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.168340] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.171608] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.173528] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.175540] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.177148] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.179318] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.180885] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.183179] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.184967] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.186080] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.187049] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.187879] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.188920] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.190086] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.191081] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.192502] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.193722] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.194617] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.195705] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.196780] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.197898] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.198864] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.199952] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.201138] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.202234] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.203132] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.204079] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.205306] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.206452] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.207700] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.208730] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.209750] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.210690] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.211784] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.212541] systemd[1]: Reached target Switch Root.677gitlab # [ 4.213257] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.334978] initrd-nixos-activation-start[225]: booting system configuration /nix/store/3h8465lmn1hnkg3xpdhy0z4xn2dfr79a-nixos-system-gitlab-test679gitlab # [ 4.389195] initrd-nixos-activation-start[225]: running activation script...680gitlab # [ 4.650546] initrd-nixos-activation-start[248]: setting up /etc...681gitlab # [ 4.740278] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.741631] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.744791] systemd[1]: Starting Switch Root...684gitlab # [ 4.779884] systemd[1]: Switching root.685gitlab # [ 4.996216] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.117736] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.488191] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.498579] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.500449] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.502434] systemd[1]: Detected first boot.691gitlab # [ 5.504998] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.646130] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.720631] systemd[1]: Applying preset policy.694gitlab # [ 5.898663] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 6.022078] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 6.023481] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 6.025728] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 6.027988] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 6.029352] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 6.030880] systemd[1]: Created slice User and Session Slice.701gitlab # [ 6.031797] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 6.033004] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 6.034079] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 6.034796] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 6.035677] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 6.036510] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 6.037295] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 6.038104] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 6.038980] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 6.039923] systemd[1]: Reached target Path Units.711gitlab # [ 6.040654] systemd[1]: Reached target Remote File Systems.712gitlab # [ 6.041454] systemd[1]: Reached target Slice Units.713gitlab # [ 6.042169] systemd[1]: Reached target Swaps.714gitlab # [ 6.043651] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 6.046025] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 6.047489] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 6.049108] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 6.050080] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 6.052626] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 6.054064] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 6.056067] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 6.057382] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 6.058594] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 6.060021] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 6.062742] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 6.063909] systemd[1]: Listening on udev Control Socket.727gitlab # [ 6.064850] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 6.068046] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.070208] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.072319] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.075506] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.080467] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.083108] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.093920] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.099432] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.103161] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.107389] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.139654] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.141445] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.156087] systemd[1]: Starting Journal Service...741gitlab # [ 6.158007] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.160522] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.174590] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.177325] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.183355] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.191817] systemd-journald[319]: Collecting audit messages is enabled.747gitlab # [ 6.193173] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.195775] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.197842] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.199690] EXT4-fs (vda): re-mounted 10b9410f-0786-42ed-853d-e537f1106f4c.751gitlab # [ 6.199939] systemd[1]: Mounted Kernel Debug File System.752gitlab # [ 6.203374] loop: module loaded753gitlab # [ 6.204953] systemd[1]: Mounted Kernel Trace File System.754gitlab # [ 6.057123] systemd[1]: Queued start job for default target Multi-User System.755gitlab # [ 6.206838] systemd[1]: Started Journal Service.756gitlab # [ 6.063316] systemd[1]: Unnecessary job was removed for /dev/vdb.757gitlab # [ 6.066797] systemd[1]: systemd-journald.service: Deactivated successfully.758gitlab # [ 6.068829] systemd-modules-load[320]: Using 3 probe threads759gitlab # [ 6.069838] systemd-modules-load[320]: Inserted module 'loop'760gitlab # [ 6.070848] systemd[1]: Finished Create List of Static Device Nodes.761gitlab # [ 6.071977] systemd[1]: modprobe@configfs.service: Deactivated successfully.762gitlab # [ 6.073424] systemd[1]: Finished Load Kernel Module configfs.763gitlab # [ 6.074492] systemd[1]: Mounted FUSE Control File System.764gitlab # [ 6.075477] systemd-modules-load[320]: Inserted module 'tls'765gitlab # [ 6.076443] systemd[1]: Finished Remount Root and Kernel File Systems.766gitlab # [ 6.077577] systemd[1]: Finished Load Kernel Modules.767gitlab # [ 6.078407] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 6.079450] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 6.081620] systemd-oomd[321]: No swap; memory pressure usage will be degraded770gitlab # [ 6.083597] systemd[1]: Starting Firewall...771gitlab # [ 6.086792] systemd[1]: Starting Flush Journal to Persistent Storage...772gitlab # [ 6.089792] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore773gitlab # [ 6.093669] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 6.094678] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 6.097321] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 6.098645] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 6.248609] systemd-journald[319]: Received client request to flush runtime journal.778gitlab # [ 6.148818] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 6.150137] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 6.151219] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 6.152227] systemd[1]: Reached target First Boot Complete.782gitlab # [ 6.153209] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 6.154026] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 6.155216] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 6.157084] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 6.158150] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 6.159119] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 6.160156] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 6.182477] systemd-udevd[365]: Using default interface naming scheme 'v261'.790gitlab # [ 6.193214] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.211703] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.286492] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.300880] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.313528] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.316030] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.321948] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.797gitlab # [ 6.324534] (udev-worker)[434]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.331188] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.332410] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.333969] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.336224] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.337833] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.339159] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.347346] systemd[1]: Finished Firewall.805gitlab # [ 6.538472] rtc_cmos 00:05: RTC can wake from S4806gitlab # [ 6.539456] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3807gitlab # [ 6.547323] ACPI: button: Power Button [PWRF]808gitlab # [ 6.548606] rtc_cmos 00:05: registered as rtc0809gitlab # [ 6.549785] rtc_cmos 00:05: setting system clock to 2026-10-02T16:52:32 UTC (1790959952)810gitlab # [ 6.551621] Floppy drive(s): fd0 is 2.88M AMI BIOS811gitlab # [ 6.555374] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs812gitlab # [ 6.564137] FDC 0 is a S82078B813gitlab # [ 6.574664] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console814gitlab # [ 6.586801] Console: switching to colour dummy device 80x25815gitlab # [ 6.588996] [drm] Found bochs VGA, ID 0xb0c5.816gitlab # [ 6.588998] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.817gitlab # [ 6.589302] parport_pc 00:03: reported by Plug and Play ACPI818gitlab # [ 6.591719] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic819gitlab # [ 6.591732] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]820gitlab # [ 6.593647] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0821gitlab # [ 6.595156] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4822gitlab # [ 6.598676] mousedev: PS/2 mouse device common for all mice823gitlab # [ 6.603425] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0824gitlab # [ 6.609158] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD825gitlab # [ 6.613205] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6826gitlab # [ 6.616098] Console: switching to colour frame buffer device 160x50827gitlab # [ 6.624994] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device828gitlab # [ 6.634114] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5829gitlab # [ 6.506227] systemd[1]: Starting Virtual Console Setup...830gitlab # [ 6.533271] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.831gitlab # [ 6.534484] systemd[1]: Stopped Virtual Console Setup.832gitlab # [ 6.712950] ppdev: user-space parallel port driver833gitlab # [ 6.566992] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.573782] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.835gitlab # [ 6.575888] systemd[1]: Stopped Virtual Console Setup.836gitlab # [ 6.580645] systemd[1]: Starting Virtual Console Setup...837gitlab # [ 6.765053] kvm_amd: TSC scaling supported838gitlab # [ 6.765750] kvm_amd: Nested Virtualization enabled839gitlab # [ 6.766453] kvm_amd: Nested Paging enabled840gitlab # [ 6.767000] kvm_amd: LBR virtualization supported841gitlab # [ 6.767762] kvm_amd: Virtual VMLOAD VMSAVE supported842gitlab # [ 6.768546] kvm_amd: Virtual GIF supported843gitlab # [ 6.769067] kvm_amd: Virtual NMI enabled844gitlab # [ 6.805899] EDAC MC: Ver: 3.0.0845gitlab # [ 6.660163] systemd-vconsole-setup[492]: Configuration of first virtual console was skipped, ignoring remaining ones.846gitlab # [ 6.663054] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 6.878422] systemd[1]: Mounting /run/wrappers...848gitlab # [ 6.901219] systemd[1]: Mounted /run/wrappers.849gitlab # [ 6.903181] systemd[1]: Reached target Local File Systems.850gitlab # [ 6.905402] systemd[1]: Listening on Boot Loader Control Service Socket.851gitlab # [ 6.907893] systemd[1]: Starting register-nix-paths.service...852gitlab # [ 6.910268] systemd[1]: Starting Create SUID/SGID Wrappers...853gitlab # [ 6.912449] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.854gitlab # [ 6.915863] systemd[1]: Starting Save Transient machine-id to Disk...855gitlab # [ 6.918246] systemd[1]: Starting Create System Files and Directories...856gitlab # [ 6.957346] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.857gitlab # [ 6.960578] systemd[1]: Finished Save Transient machine-id to Disk.858gitlab # [ 6.963118] systemd[1]: Finished Create System Files and Directories.859gitlab # [ 6.965574] systemd[1]: Starting Rebuild Journal Catalog...860gitlab # [ 6.967847] systemd[1]: Starting Record System Boot/Shutdown in UTMP...861gitlab # [ 6.985315] systemd[1]: Finished Record System Boot/Shutdown in UTMP.862gitlab # [ 7.010159] systemd[1]: Finished Rebuild Journal Catalog.863gitlab # [ 7.012828] systemd[1]: Starting Update is Completed...864gitlab # [ 7.030795] systemd[1]: Finished Update is Completed.865gitlab # [ 7.088927] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.866gitlab # [ 7.091293] systemd[1]: Finished Create SUID/SGID Wrappers.867gitlab # [ 7.395789] systemd[1]: Finished register-nix-paths.service.868gitlab # [ 7.397154] systemd[1]: Reached target System Initialization.869gitlab # [ 7.398301] systemd[1]: Started Discard unused filesystem blocks once a week.870gitlab # [ 7.399569] systemd[1]: Started logrotate.timer.871gitlab # [ 7.400531] systemd[1]: Started Daily Cleanup of Temporary Directories.872gitlab # [ 7.401715] systemd[1]: Reached target Timer Units.873gitlab # [ 7.402684] systemd[1]: Listening on D-Bus System Message Bus Socket.874gitlab # [ 7.403830] systemd[1]: Listening on Nix Daemon Socket.875gitlab # [ 7.410848] systemd[1]: Starting nixbot CI service socket...876gitlab # [ 7.411982] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.877gitlab # [ 7.413444] systemd[1]: Listening on nixbot CI service socket.878gitlab # [ 7.414800] systemd[1]: Reached target Socket Units.879gitlab # [ 7.417403] systemd[1]: Starting D-Bus System Message Bus...880gitlab # [ 7.474685] dbus-broker-launch[574]: Looking up NSS user entry for 'systemd-timesync'...881gitlab # [ 7.476406] dbus-broker-launch[574]: NSS returned no entry for 'systemd-timesync'882gitlab # [ 7.477822] dbus-broker-launch[574]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"883gitlab # [ 7.482767] systemd[1]: Started D-Bus System Message Bus.884gitlab # [ 7.501184] dbus-broker-launch[574]: Ready885gitlab # [ 7.505302] systemd[1]: Reached target Basic System.886gitlab # [ 7.510072] systemd[1]: Started backdoor.service.887gitlab # [ 7.514701] systemd[1]: Starting gitlab-config.service...888gitlab # [ 7.518964] systemd[1]: Starting Import lastlog data into lastlog2 database...889gitlab # [ 7.535248] systemd[1]: Starting Logrotate configuration check...890gitlab # [ 7.542174] systemd[1]: Starting Name Service Cache Daemon (nsncd)...891gitlab # [ 7.547273] systemd[1]: Starting Post-Boot Actions...892gitlab # [ 7.562281] systemd[1]: Started Reset console on configuration changes.893gitlab # [ 7.565320] systemd[1]: Starting resolvconf update...894gitlab # connecting to host...895gitlab # [ 7.571383] logrotate[579]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.896gitlab # [ 7.572176] logrotate[579]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf897gitlab # [ 7.573078] logrotate[579]: note: 'monthly' overrides previously specified 'weekly'898gitlab # [ 7.573970] logrotate[579]: Reading state from file: /var/lib/logrotate.status899gitlab # [ 7.574713] logrotate[579]: state file /var/lib/logrotate.status does not exist900gitlab # [ 7.575651] logrotate[579]: Allocating hash table for state file, size 64 entries901gitlab # [ 7.576579] logrotate[579]: Handling 4 logs902gitlab # [ 7.577354] logrotate[579]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed903gitlab # [ 7.578558] logrotate[579]: considering log /var/log/btmp904gitlab # [ 7.579477] logrotate[579]: Creating new state905gitlab # [ 7.580239] logrotate[579]: Now: 2026-10-02 16:52906gitlab # [ 7.580896] logrotate[579]: Last rotated at 2026-10-02 16:00907gitlab # [ 7.582642] logrotate[579]: log does not need rotating (log has already been rotated)908gitlab # [ 7.583463] logrotate[579]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed909gitlab # [ 7.583804] logrotate[579]: considering log /var/log/wtmp910gitlab: Guest shell says: b'Spawning backdoor root shell...\n'911gitlab # [ 7.584414] logrotate[579]: Creating new state912gitlab # [ 7.584910] logrotate[579]: Now: 2026-10-02 16:52913gitlab # [ 7.585544] logrotate[579]: Last rotated at 2026-10-02 16:00914gitlab # [ 7.586094] logrotate[579]: log does not need rotating (log has already been rotated)915gitlab: connected to guest root shell916gitlab # [ 7.586547] logrotate[579]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab: (connecting took 8.26 seconds)918gitlab # [ 7.587104] logrotate[579]: switching euid from 0 to 165 and egid from 0 to 165 (pid 579)919gitlab: (finished: waiting for the VM to finish booting, in 8.26 seconds)920gitlab # [ 7.587337] logrotate[579]: considering log /var/gitlab/state/log/*.log921gitlab # [ 7.587797] logrotate[579]: log /var/gitlab/state/log/*.log does not exist -- skipping922gitlab # [ 7.588400] logrotate[579]: Creating new state923gitlab # [ 7.588847] logrotate[579]: switching euid from 165 to 0 and egid from 165 to 0 (pid 579)924gitlab # [ 7.589475] logrotate[579]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed925gitlab # [ 7.589912] logrotate[579]: switching euid from 0 to 60 and egid from 0 to 60 (pid 579)926gitlab # [ 7.590512] logrotate[579]: considering log /var/log/nginx/*.log927gitlab # [ 7.590969] logrotate[579]: log /var/log/nginx/*.log does not exist -- skipping928gitlab # [ 7.591574] logrotate[579]: Creating new state929gitlab # [ 7.592049] logrotate[579]: not running postrotate script, since no logs were rotated930gitlab # [ 7.592500] logrotate[579]: switching euid from 60 to 0 and egid from 60 to 0 (pid 579)931gitlab # [ 7.595181] systemd[1]: Finished Logrotate configuration check.932gitlab # [ 7.597294] systemd[1]: Finished Post-Boot Actions.933gitlab # [ 7.603494] systemd[1]: Finished Import lastlog data into lastlog2 database.934gitlab # [ 7.618375] systemd[1]: Started Name Service Cache Daemon (nsncd).935gitlab # [ 7.619710] nsncd[580]: Oct 02 16:52:33.716 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"936gitlab # [ 7.622401] systemd[1]: Reached target Host and Network Name Lookups.937gitlab # [ 7.623572] systemd[1]: Reached target User and Group Name Lookups.938gitlab # [ 7.628623] systemd[1]: Starting User Login Management...939gitlab # [ 7.663506] systemd[1]: Stopped target Host and Network Name Lookups.940gitlab # [ 7.664509] systemd[1]: Stopping Host and Network Name Lookups...941gitlab # [ 7.665560] systemd[1]: Stopped target User and Group Name Lookups.942gitlab # [ 7.666573] systemd[1]: Stopping User and Group Name Lookups...943gitlab # [ 7.667495] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...944gitlab # [ 7.669098] systemd-logind[629]: New seat seat0.945gitlab # [ 7.670335] systemd-logind[629]: Watching system buttons on /dev/input/event2 (Power Button)946gitlab # [ 7.672062] systemd-logind[629]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)947gitlab # [ 7.673767] systemd-logind[629]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)948gitlab # [ 7.675233] systemd[1]: nscd.service: Deactivated successfully.949gitlab # [ 7.676226] systemd[1]: Stopped Name Service Cache Daemon (nsncd).950gitlab # [ 7.677248] systemd[1]: nscd.service: Consumed 42ms CPU time over 127ms wall clock time, 7.3M memory peak, 5.5M read from disk.951gitlab # [ 7.678978] systemd[1]: Started User Login Management.952gitlab # [ 7.679844] systemd[1]: Starting linger-users.service...953gitlab # [ 7.682655] systemd[1]: Starting Name Service Cache Daemon (nsncd)...954gitlab # [ 7.699452] systemd[1]: linger-users.service: Deactivated successfully.955gitlab # [ 7.700883] nsncd[672]: Oct 02 16:52:33.798 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.701703] systemd[1]: Finished linger-users.service.957gitlab # [ 7.702231] systemd[1]: Started Name Service Cache Daemon (nsncd).958gitlab # [ 7.702856] systemd[1]: Finished resolvconf update.959gitlab # [ 7.706089] systemd[1]: Reached target Preparation for Network.960gitlab # [ 7.706439] systemd[1]: Reached target Host and Network Name Lookups.961gitlab # [ 7.706936] systemd[1]: Reached target User and Group Name Lookups.962gitlab # [ 7.708334] systemd[1]: Starting DHCP Client...963gitlab # [ 7.709868] systemd[1]: Starting Address configuration of eth1...964gitlab # [ 7.712398] systemd[1]: Starting Extra networking commands....965gitlab # [ 7.741358] network-addresses-eth1-start[697]: adding address 192.168.1.1/24... done966gitlab # [ 7.745649] network-addresses-eth1-start[697]: adding address 2001:db8:1::1/64... done967gitlab # [ 7.751153] systemd[1]: Finished Address configuration of eth1.968gitlab # [ 7.782118] dhcpcd[706]: dhcpcd-10.3.2 starting969gitlab # [ 7.784071] dhcpcd[761]: dev: loaded udev970gitlab # [ 7.784904] systemd[1]: Finished Extra networking commands..971gitlab # [ 7.785847] systemd[1]: Reached target Network.972gitlab # [ 7.788197] systemd[1]: Starting gitlab-workhorse.service...973gitlab # [ 7.938366] 8021q: 802.1Q VLAN Support v1.8974gitlab # [ 7.938986] 8021q: adding VLAN 0 to HW filter on device eth1975gitlab # [ 7.790464] systemd[1]: Starting Nginx Web Server...976gitlab # [ 7.795675] systemd[1]: Starting PostgreSQL Server...977gitlab # [ 7.798773] systemd[1]: Starting Redis Server - redis-gitlab...978gitlab # [ 7.801325] systemd[1]: Starting Permit User Sessions...979gitlab # [ 7.810668] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.980gitlab # [ 7.823313] systemd[1]: Finished Permit User Sessions.981gitlab # [ 7.826052] systemd[1]: Started Getty on tty1.982gitlab # [ 7.828384] systemd[1]: Reached target Login Prompts.983gitlab # [ 8.040993] cfg80211: Loading compiled-in X.509 certificates for regulatory database984gitlab # [ 8.049436] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'985gitlab # [ 8.052752] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'986gitlab # [ 8.054181] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2987gitlab # [ 8.055462] cfg80211: failed to load regulatory.db988gitlab # [ 7.924974] nginx-pre-start[784]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok989gitlab # [ 7.926232] nginx-pre-start[784]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful990gitlab # [ 7.934084] systemd[1]: Started Nginx Web Server.991gitlab # [ 8.086635] 8021q: adding VLAN 0 to HW filter on device eth0992gitlab # [ 7.939908] dhcpcd[761]: eth0: waiting for carrier993gitlab # [ 7.940370] dhcpcd[761]: eth0: carrier acquired994gitlab # [ 7.942884] dhcpcd[761]: DUID 00:01:00:01:32:52:9d:d2:52:54:00:12:34:56995gitlab # [ 7.943506] dhcpcd[761]: eth0: IAID 00:12:34:56996gitlab # [ 7.944043] dhcpcd[761]: eth0: adding address fe80::5054:ff:fe12:3456997gitlab # [ 7.954593] redis-server[786]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.998gitlab # [ 7.954980] redis-server[786]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo999gitlab # [ 7.955757] redis-server[786]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=786, just started1000gitlab # [ 7.955887] redis-server[786]: Configuration loaded1001gitlab # [ 7.961033] redis[786]: monotonic clock: POSIX clock_gettime1002gitlab # [ 7.964426] redis[786]: Running mode=standalone, port=0.1003gitlab # [ 7.965265] redis[786]: Server initialized1004gitlab # [ 7.965544] redis[786]: Ready to accept connections unix1005gitlab # [ 7.967531] systemd[1]: Started Redis Server - redis-gitlab.1006gitlab # [ 7.969156] redis[786]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1007gitlab # [ 7.984766] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres".1008gitlab # [ 7.985136] postgresql-pre-start[794]: This user must also own the server process.1009gitlab # [ 7.990257] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8".1010gitlab # [ 7.990626] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8".1011gitlab # [ 7.991142] postgresql-pre-start[794]: The default text search configuration will be set to "english".1012gitlab # [ 7.991648] postgresql-pre-start[794]: Data page checksums are enabled.1013gitlab # [ 7.992192] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1014gitlab # [ 7.992714] postgresql-pre-start[794]: creating subdirectories ... ok1015gitlab # [ 7.992942] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix1016gitlab # [ 8.019986] postgresql-pre-start[794]: selecting default "max_connections" ... 1001017gitlab # [ 8.067985] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB1018gitlab # [ 8.349258] systemd[1]: Started gitlab-workhorse.service.1019gitlab # [ 8.472518] postgresql-pre-start[794]: selecting default time zone ... UTC1020gitlab # [ 8.474076] postgresql-pre-start[794]: creating configuration files ... ok1021gitlab # [ 8.577362] gitlab-workhorse[822]: time="2026-10-02T16:52:34Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41022gitlab # [ 8.577571] gitlab-workhorse[822]: time="2026-10-02T16:52:34Z" level=info msg="Using redis/go-redis"1023gitlab # [ 8.578207] gitlab-workhorse[822]: time="2026-10-02T16:52:34Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1024gitlab # [ 8.648481] postgresql-pre-start[794]: running bootstrap script ... ok1025gitlab # [ 9.103184] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok1026gitlab # [ 9.223793] dhcpcd[761]: eth0: soliciting a DHCP lease1027gitlab # [ 9.383047] NET: Registered PF_PACKET protocol family1028gitlab # [ 9.246199] dhcpcd[761]: eth0: offered 10.0.2.15 from 10.0.2.21029gitlab # [ 9.250298] dhcpcd[761]: eth0: probing address 10.0.2.15/241030gitlab # [ 9.378381] postgresql-pre-start[794]: syncing data to disk ... ok1031gitlab # [ 9.378599] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections1032gitlab # [ 9.380181] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1033gitlab # [ 9.380897] postgresql-pre-start[794]: Success. You can now start the database server using:1034gitlab # [ 9.382108] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1035gitlab # [ 9.505733] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1036gitlab # [ 9.510194] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 54321037gitlab # [ 9.512941] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 54321038gitlab # [ 9.515886] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1039gitlab # [ 9.520709] postgres[862]: [862] LOG: database system was shut down at 2026-10-02 16:52:35 GMT1040gitlab # [ 9.528154] postgres[849]: [849] LOG: database system is ready to accept connections1041gitlab # [ 9.534437] systemd[1]: Started PostgreSQL Server.1042gitlab # [ 9.536235] systemd[1]: Starting PostgreSQL Setup Scripts...1043gitlab # [ 9.666535] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[856]: mkdir -p /var/gitlab/state/home/.ssh: OK1044gitlab # [ 9.672293] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[856]: chmod 700 /var/gitlab/state/home/.ssh: OK1045gitlab # [ 9.717660] postgresql-setup-start[874]: CREATE DATABASE1046gitlab # [ 9.732079] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 9.735045] systemd[1]: Started gitaly.service.1048gitlab # [ 9.739741] postgresql-setup-start[900]: CREATE ROLE1049gitlab # [ 9.749260] postgresql-setup-start[903]: ALTER DATABASE1050gitlab # [ 9.768669] postgresql-setup-start[909]: CREATE ROLE1051gitlab # [ 9.771024] systemd[1]: Finished PostgreSQL Setup Scripts.1052gitlab # [ 9.771916] systemd[1]: Reached target PostgreSQL.1053gitlab # [ 9.772951] systemd[1]: Starting gitlab-db-config.service...1054gitlab # [ 9.774153] systemd[1]: Starting gitlab-postgresql.service...1055gitlab # [ 9.867039] gitlab-postgresql-start[919]: CREATE DATABASE1056gitlab # [ 9.919926] gitlab-postgresql-start[924]: CREATE EXTENSION1057gitlab # [ 10.005785] gitlab-postgresql-start[926]: CREATE EXTENSION1058gitlab # [ 10.008949] systemd[1]: Finished gitlab-postgresql.service.1059gitlab # [ 10.251355] gitaly[901]: time="2026-10-02T16:52:36.348Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9011060gitlab # [ 10.252274] gitaly[901]: time="2026-10-02T16:52:36.349Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9011061gitlab # [ 10.253392] gitaly[901]: time="2026-10-02T16:52:36.349Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9011062gitlab # [ 10.254179] gitaly[901]: time="2026-10-02T16:52:36.349Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9011063gitlab # [ 10.254869] gitaly[901]: time="2026-10-02T16:52:36.349Z" level=info msg="Starting Gitaly" pid=901 version=1064gitlab # [ 10.420469] gitaly[901]: time="2026-10-02T16:52:36.518Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=169 pid=9011065gitlab # [ 10.420946] gitaly[901]: time="2026-10-02T16:52:36.519Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9011066gitlab # [ 10.421702] gitaly[901]: time="2026-10-02T16:52:36.520Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9011067gitlab # [ 10.422526] gitaly[901]: time="2026-10-02T16:52:36.520Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-901/git-exec-2208323034.d/git pid=9011068gitlab # [ 10.427494] gitaly[901]: time="2026-10-02T16:52:36.525Z" level=info msg="finished detecting git version" duration_ms=4 pid=9011069gitlab # [ 10.428345] gitaly[901]: time="2026-10-02T16:52:36.526Z" level=info msg="using Git version" pid=901 version=2.53.g1070gitlab # [ 10.429080] gitaly[901]: time="2026-10-02T16:52:36.527Z" level=info msg="clearing disk cache object folder" pid=901 storage=default1071gitlab # [ 10.429579] gitaly[901]: time="2026-10-02T16:52:36.527Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4234731743 pid=901 storage=default1072gitlab # [ 10.430831] gitaly[901]: time="2026-10-02T16:52:36.527Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4234731743 pid=901 storage=default1073gitlab # [ 10.431922] gitaly[901]: time="2026-10-02T16:52:36.527Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9011074gitlab # [ 10.432694] gitaly[901]: time="2026-10-02T16:52:36.527Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9011075gitlab # [ 10.433553] gitaly[901]: time="2026-10-02T16:52:36.528Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache4234731743 clear_duration_ms=0 pid=901 storage=default1076gitlab # [ 10.466341] gitaly[901]: time="2026-10-02T16:52:36.564Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9011077gitlab # [ 10.466541] gitaly[901]: time="2026-10-02T16:52:36.564Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=901 schema=unix1078gitlab # [ 10.468166] gitaly[901]: time="2026-10-02T16:52:36.564Z" level=info msg="listening at address" address=/run/gitaly/gitaly-901/sock.d/intern pid=901 schema=unix1079gitlab # [ 10.469238] gitaly[901]: time="2026-10-02T16:52:36.565Z" level=info msg="finished tempdir cleaner walk" pid=901 storage=default time_ms=01080gitlab # [ 10.469702] gitaly[901]: time="2026-10-02T16:52:36.565Z" level=info msg="counting repositories" pid=9011081gitlab # [ 10.470234] gitaly[901]: time="2026-10-02T16:52:36.565Z" level=info msg="starting to count repositories" pid=901 storage_path=/var/gitlab/state/repositories1082gitlab # [ 10.470675] gitaly[901]: time="2026-10-02T16:52:36.565Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9011083gitlab # [ 10.471189] gitaly[901]: time="2026-10-02T16:52:36.565Z" level=info msg="Started Gitaly" duration_ms=216 pid=9011084gitlab # [ 10.471663] gitaly[901]: time="2026-10-02T16:52:36.565Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9011085gitlab # [ 10.472169] gitaly[901]: time="2026-10-02T16:52:36.566Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=901 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.472639] gitaly[901]: time="2026-10-02T16:52:36.566Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9011087gitlab # [ 10.473129] gitaly[901]: time="2026-10-02T16:52:36.566Z" level=info msg="maintenance: daily scheduled" pid=901 scheduled="2026-10-03 12:00:00 +0000 UTC"1088gitlab # [ 10.517557] dhcpcd[761]: eth0: soliciting an IPv6 router1089gitlab # [ 10.517962] dhcpcd[761]: eth0: Router Advertisement from fe80::21090gitlab # [ 10.519309] dhcpcd[761]: eth0: adding address fec0::5054:ff:fe12:3456/641091gitlab # [ 10.520487] dhcpcd[761]: eth0: adding route to fec0::/641092gitlab # [ 10.521285] dhcpcd[761]: eth0: adding default route via fe80::21093gitlab # [ 11.401357] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1094gitlab # [ 11.401893] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1095gitlab # [ 11.439934] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1096gitlab # [ 12.464328] gitaly[901]: time="2026-10-02T16:52:38.561Z" level=info msg="License database preloaded" duration_ms=2212 pid=9011097gitlab # [ 14.013802] dhcpcd[761]: eth0: leased 10.0.2.15 for 86400 seconds1098gitlab # [ 14.014260] dhcpcd[761]: eth0: adding route to 10.0.2.0/241099gitlab # [ 14.015440] dhcpcd[761]: eth0: adding default route via 10.0.2.21100gitlab # [ 14.139399] systemd[1]: Started DHCP Client.1101gitlab # [ 14.141749] systemd[1]: Reached target Network is Online.1102gitlab # [ 42.368536] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[914]: W, [2026-10-02T16:53:08.466079 #914] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1103gitlab # [ 44.531521] postgres[1324]: [1324] ERROR: relation "feature_gates" does not exist at character 5231104gitlab # [ 44.532255] postgres[1324]: [1324] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1105gitlab # [ 44.533304] postgres[1324]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1106gitlab # [ 44.534237] postgres[1324]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1107gitlab # [ 44.535254] postgres[1324]: attidentity AS identity,1108gitlab # [ 44.536099] postgres[1324]: attgenerated as attgenerated1109gitlab # [ 44.536903] postgres[1324]: FROM pg_attribute a1110gitlab # [ 44.537938] postgres[1324]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1111gitlab # [ 44.538768] postgres[1324]: LEFT JOIN pg_type t ON a.atttypid = t.oid1112gitlab # [ 44.539943] postgres[1324]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1113gitlab # [ 44.540837] postgres[1324]: WHERE a.attrelid = '"feature_gates"'::regclass1114gitlab # [ 44.541814] postgres[1324]: AND a.attnum > 0 AND NOT a.attisdropped1115gitlab # [ 44.542848] postgres[1324]: ORDER BY a.attnum1116gitlab # [ 44.543841] postgres[1324]:1117gitlab # [ 48.142094] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1357]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1118gitlab # [ 48.142968] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1357]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1119gitlab # [ 48.629427] gitlab-workhorse[822]: time="2026-10-02T16:53:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 58.639574] gitlab-workhorse[822]: time="2026-10-02T16:53:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 63.620422] postgres[1432]: [1432] ERROR: relation "table_without_models" does not exist1122gitlab # [ 63.621115] postgres[1432]: [1432] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1123gitlab # [ 68.648765] gitlab-workhorse[822]: time="2026-10-02T16:53:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1124gitlab # [ 75.228695] systemd[1]: Finished gitlab-db-config.service.1125gitlab # [ 75.235394] systemd[1]: Started gitlab-sidekiq.service.1126gitlab # [ 75.239724] systemd[1]: Starting gitlab.service...1127gitlab # [ 75.590419] bundle[1599]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1128gitlab # [ 75.595279] bundle[1599]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1129gitlab # [ 75.599960] bundle[1599]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1130gitlab # [ 78.483824] sidekiq-cluster[1598]: {"severity":"INFO","time":"2026-10-02T16:53:44.563Z","message":"Starting cluster with 1 processes"}1131gitlab # [ 78.492422] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.569Z","pid":1599,"message":"* Enabling systemd notification integration"}1132gitlab # [ 78.492611] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"Puma starting in cluster mode..."}1133gitlab # [ 78.493743] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1134gitlab # [ 78.496762] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1135gitlab # [ 78.499569] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Min threads: 0"}1136gitlab # [ 78.501107] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Max threads: 4"}1137gitlab # [ 78.503091] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Environment: production"}1138gitlab # [ 78.504154] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Master PID: 1599"}1139gitlab # [ 78.505326] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Workers: 2"}1140gitlab # [ 78.506482] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1141gitlab # [ 78.508079] bundle[1599]: {"timestamp":"2026-10-02T16:53:44.589Z","pid":1599,"message":"* Preloading application"}1142gitlab # [ 78.649746] gitlab-workhorse[822]: time="2026-10-02T16:53:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 88.659580] gitlab-workhorse[822]: time="2026-10-02T16:53:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144gitlab # [ 98.660966] gitlab-workhorse[822]: time="2026-10-02T16:54:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 102.086866] bundle[1599]: W, [2026-10-02T16:54:08.184517 #1599] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 105.314849] sidekiq-cluster[1629]: 2026-10-02T16:54:11.412Z pid=1629 tid=wl1 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1629, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>452513792}1147gitlab # [ 105.499071] sidekiq-cluster[1629]: W, [2026-10-02T16:54:11.597149 #1629] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1148gitlab # [ 105.540935] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:11.639Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1149gitlab # [ 107.546314] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.643Z","message":"GitLab reliable fetch activated!"}1150gitlab # [ 107.547071] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.643Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1151gitlab # [ 107.573630] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.671Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1152gitlab # [ 107.578098] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.676Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1153gitlab # [ 107.582844] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.681Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1154gitlab # [ 107.589428] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.687Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1155gitlab # [ 107.596943] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.695Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1156gitlab # [ 107.603377] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.701Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1157gitlab # [ 107.609546] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.707Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1158gitlab # [ 107.614640] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.712Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1159gitlab # [ 107.619709] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.717Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1160gitlab # [ 107.625124] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.723Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1161gitlab # [ 107.630515] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.728Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1162gitlab # [ 107.636967] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.735Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1163gitlab # [ 107.642106] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.740Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1164gitlab # [ 107.647447] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.745Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1165gitlab # [ 107.653095] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.751Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1166gitlab # [ 107.658850] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.757Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1167gitlab # [ 107.665550] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.763Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1168gitlab # [ 107.671885] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.770Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1169gitlab # [ 107.678131] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.776Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1170gitlab # [ 107.684766] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.782Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1171gitlab # [ 107.690654] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.788Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1172gitlab # [ 107.697212] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.795Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1173gitlab # [ 107.703365] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.801Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1174gitlab # [ 107.708812] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.807Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1175gitlab # [ 107.714543] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.812Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1176gitlab # [ 107.720822] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.819Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1177gitlab # [ 107.726984] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.825Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1178gitlab # [ 107.733118] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.831Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1179gitlab # [ 107.738536] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.836Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1180gitlab # [ 107.746524] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.844Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1181gitlab # [ 107.750515] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.848Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1182gitlab # [ 107.755904] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.854Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1183gitlab # [ 107.761189] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.859Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1184gitlab # [ 107.766470] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.864Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1185gitlab # [ 107.771502] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.869Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1186gitlab # [ 107.775836] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.874Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1187gitlab # [ 107.780579] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.878Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1188gitlab # [ 107.785934] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.884Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1189gitlab # [ 107.790682] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.888Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1190gitlab # [ 107.794545] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.892Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1191gitlab # [ 107.798824] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.897Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1192gitlab # [ 107.802704] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.901Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1193gitlab # [ 107.806832] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.905Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1194gitlab # [ 107.811217] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.909Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1195gitlab # [ 107.815749] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.914Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1196gitlab # [ 107.818662] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.917Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1197gitlab # [ 107.821502] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.919Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1198gitlab # [ 107.824671] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.923Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1199gitlab # [ 107.827712] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.926Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1200gitlab # [ 107.830492] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.928Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1201gitlab # [ 107.833263] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.931Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1202gitlab # [ 107.861100] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.959Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1203gitlab # [ 107.870535] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.968Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1204gitlab # [ 107.873862] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.972Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1205gitlab # [ 107.878200] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.976Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1206gitlab # [ 107.881817] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.980Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1207gitlab # [ 107.886327] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.984Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1208gitlab # [ 107.890330] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.988Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1209gitlab # [ 107.893921] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.992Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1210gitlab # [ 107.896913] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.995Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1211gitlab # [ 107.900614] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:13.998Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1212gitlab # [ 107.903267] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.001Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1213gitlab # [ 107.907246] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.005Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1214gitlab # [ 107.910377] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.008Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1215gitlab # [ 107.913982] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.012Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1216gitlab # [ 107.917616] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.015Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1217gitlab # [ 107.920231] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.018Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1218gitlab # [ 107.923188] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.021Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1219gitlab # [ 107.925489] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.023Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1220gitlab # [ 107.928182] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.026Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1221gitlab # [ 107.930951] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.028Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1222gitlab # [ 107.933246] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.031Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1223gitlab # [ 107.936135] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.034Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1224gitlab # [ 107.938430] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.036Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1225gitlab # [ 107.941540] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.039Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1226gitlab # [ 107.944060] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.042Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1227gitlab # [ 107.946526] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.044Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1228gitlab # [ 107.949511] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.047Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1229gitlab # [ 107.952421] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.050Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1230gitlab # [ 107.955276] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.053Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1231gitlab # [ 107.957675] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.056Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1232gitlab # [ 107.960168] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.058Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1233gitlab # [ 107.963530] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.061Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1234gitlab # [ 107.965732] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.064Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1235gitlab # [ 107.967880] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.066Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1236gitlab # [ 107.970061] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.068Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1237gitlab # [ 107.972932] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.071Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1238gitlab # [ 107.974709] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.073Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1239gitlab # [ 107.977434] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.075Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1240gitlab # [ 107.979493] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.077Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1241gitlab # [ 107.981696] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.080Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1242gitlab # [ 107.984339] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.082Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1243gitlab # [ 107.986580] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.084Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1244gitlab # [ 107.989612] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.088Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1245gitlab # [ 107.992147] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.090Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1246gitlab # [ 107.994789] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.093Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1247gitlab # [ 107.996648] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.095Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1248gitlab # [ 107.999473] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.097Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1249gitlab # [ 108.008579] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.106Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1250gitlab # [ 108.010521] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.108Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1251gitlab # [ 108.012606] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.111Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1252gitlab # [ 108.016059] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.114Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1253gitlab # [ 108.018420] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.116Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1254gitlab # [ 108.020859] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.119Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1255gitlab # [ 108.023152] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.121Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1256gitlab # [ 108.025306] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.123Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1257gitlab # [ 108.027455] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.125Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1258gitlab # [ 108.030460] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.128Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1259gitlab # [ 108.032474] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:14.130Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1260gitlab # [ 108.662268] gitlab-workhorse[822]: time="2026-10-02T16:54:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 118.672186] gitlab-workhorse[822]: time="2026-10-02T16:54:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1262gitlab # [ 128.674073] gitlab-workhorse[822]: time="2026-10-02T16:54:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 130.345640] postgres[2085]: [2085] ERROR: relation "table_without_models" does not exist1264gitlab # [ 130.346248] postgres[2085]: [2085] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 130.890849] postgres[2105]: [2105] ERROR: relation "table_without_models" does not exist1266gitlab # [ 130.891689] postgres[2105]: [2105] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1267gitlab # [ 132.766193] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:38.864Z","message":"Booted Rails 7.2.3.1 application in production environment"}1268gitlab # [ 132.769112] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:38.866Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1269gitlab # [ 132.769877] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:38.866Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1270gitlab # [ 132.770846] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:38.866Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1271gitlab # [ 132.771741] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:38.868Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1272gitlab # [ 133.604564] bundle[1599]: {"timestamp":"2026-10-02T16:54:39.701Z","pid":1599,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1273gitlab # [ 133.604925] bundle[1599]: {"timestamp":"2026-10-02T16:54:39.702Z","pid":1599,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1274gitlab # [ 133.606773] bundle[1599]: {"timestamp":"2026-10-02T16:54:39.702Z","pid":1599,"message":"! #\u003cThread:0x000073e176cacad0 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1275gitlab # [ 133.608102] bundle[1599]: {"timestamp":"2026-10-02T16:54:39.702Z","pid":1599,"message":"! #\u003cThread:0x000073e176ef8f28 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1276gitlab # [ 133.608679] bundle[1599]: {"timestamp":"2026-10-02T16:54:39.702Z","pid":1599,"message":"Use Ctrl-C to stop"}1277gitlab # [ 133.610221] bundle[1599]: {"timestamp":"2026-10-02T16:54:39.702Z","pid":1599,"message":"Sending status to systemd every 1.0 sec"}1278gitlab # [ 134.021469] bundle[1599]: {"timestamp":"2026-10-02T16:54:40.119Z","pid":1599,"message":"- Worker 1 (PID: 2167) booted in 0.34s, phase: 0"}1279gitlab # [ 134.061961] bundle[1599]: {"timestamp":"2026-10-02T16:54:40.160Z","pid":1599,"message":"- Worker 0 (PID: 2163) booted in 0.39s, phase: 0"}1280gitlab # [ 134.068273] systemd[1]: Started gitlab.service.1281gitlab # [ 134.070310] systemd[1]: Reached target Common target for all GitLab services..1282gitlab # [ 134.076688] systemd[1]: Starting setup-gitlab.service...1283gitlab # [ 134.095272] setup-gitlab-start[2200]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1284gitlab # [ 134.138848] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:40.236Z","message":"Cleaning working queues"}1285gitlab # [ 134.142483] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:40.237Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d3df1abdd62c641b1f1a33f9","created_at":"2026-10-02T16:53:40.963Z","trace_propagation_headers":{"sentry-trace":"3c75198e883d4c52bdce9a5ef146dd9a-fb7f022e328e40d1","baggage":"sentry-trace_id=3c75198e883d4c52bdce9a5ef146dd9a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f9c0186536bbb6b13a9dcfeb20b9360f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T16:53:40.978Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d3df1abdd62c641b1f1a33f9: start","job_status":"start","queue_duration_s":59.259694,"scheduling_latency_s":59.259742}1286gitlab # [ 134.270606] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:54:40.368Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"d3df1abdd62c641b1f1a33f9","created_at":"2026-10-02T16:53:40.963Z","trace_propagation_headers":{"sentry-trace":"3c75198e883d4c52bdce9a5ef146dd9a-fb7f022e328e40d1","baggage":"sentry-trace_id=3c75198e883d4c52bdce9a5ef146dd9a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f9c0186536bbb6b13a9dcfeb20b9360f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T16:53:40.978Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-d3df1abdd62c641b1f1a33f9: done: 0.130787 sec","job_status":"done","queue_duration_s":59.259694,"scheduling_latency_s":59.259742,"redis_calls":24,"redis_duration_s":0.004458,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.001966,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001576,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.080807477,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.130787,"completed_at":"2026-10-02T16:54:40.368Z","load_balancing_strategy":"primary","db_duration_s":0.048104,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1287gitlab # [ 136.456364] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:54:42 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 23421288gitlab # [ 136.461248] setup-gitlab-start[2200]: + TOKEN=nixbot-test-token-of-20-chars1289gitlab # [ 136.463802] setup-gitlab-start[2200]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1290gitlab # [ 136.476481] runuser[2226]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1291gitlab # [ 136.866761] setup-gitlab-start[2227]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1292gitlab # [ 136.867227] setup-gitlab-start[2227]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1293gitlab # [ 136.868552] setup-gitlab-start[2227]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1294gitlab # [ 137.448726] setup-gitlab-start[2227]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1295gitlab # [ 137.449260] setup-gitlab-start[2227]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1296gitlab # [ 137.450695] setup-gitlab-start[2227]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1297gitlab # [ 160.984193] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"87173984146cc39411c7a345","created_at":"2026-10-02T16:55:07.036Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711608130bbbb845eb7d561040b31337","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-02T16:55:07.078Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-87173984146cc39411c7a345: start","job_status":"start","queue_duration_s":0.002965,"scheduling_latency_s":0.003008}1298gitlab # [ 161.020069] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.118Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1299gitlab # [ 161.041563] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"87173984146cc39411c7a345","created_at":"2026-10-02T16:55:07.036Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711608130bbbb845eb7d561040b31337","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-02T16:55:07.078Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-87173984146cc39411c7a345: done: 0.058134 sec","job_status":"done","queue_duration_s":0.002965,"scheduling_latency_s":0.003008,"redis_calls":10,"redis_duration_s":0.013344,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002650337,"duration_s":0.058134,"completed_at":"2026-10-02T16:55:07.139Z","load_balancing_strategy":"primary","db_duration_s":0.00114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 161.044224] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.142Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"23f52fffe21e53eed7a4e224","created_at":"2026-10-02T16:55:07.091Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b77b182d05f4c4e429082527985545e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.108Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-23f52fffe21e53eed7a4e224: start","job_status":"start","queue_duration_s":0.033466,"scheduling_latency_s":0.033501}1301gitlab # [ 161.126641] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"23f52fffe21e53eed7a4e224","created_at":"2026-10-02T16:55:07.091Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b77b182d05f4c4e429082527985545e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.108Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-23f52fffe21e53eed7a4e224: done: 0.082403 sec","job_status":"done","queue_duration_s":0.033466,"scheduling_latency_s":0.033501,"redis_calls":12,"redis_duration_s":0.01379,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002923,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001309943,"exclusive_lock_hold_duration_s":0.006451099,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.082403,"completed_at":"2026-10-02T16:55:07.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002579,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 161.171472] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"918e64727cf6c6a27d790388","created_at":"2026-10-02T16:55:07.124Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7f29517b2ba97cbc3dbce559680364a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.156Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-918e64727cf6c6a27d790388: start","job_status":"start","queue_duration_s":0.112741,"scheduling_latency_s":0.112801}1303gitlab # [ 161.205534] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.303Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1304gitlab # [ 161.220960] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"918e64727cf6c6a27d790388","created_at":"2026-10-02T16:55:07.124Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7f29517b2ba97cbc3dbce559680364a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.156Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-918e64727cf6c6a27d790388: done: 0.049424 sec","job_status":"done","queue_duration_s":0.112741,"scheduling_latency_s":0.112801,"redis_calls":10,"redis_duration_s":0.01031,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000481067,"duration_s":0.049424,"completed_at":"2026-10-02T16:55:07.318Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 161.260703] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.325Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"082e879d4bb72ccf8550eb95","created_at":"2026-10-02T16:55:07.173Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31acecaf4e1c8050f7b96361232c3cfb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.218Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-082e879d4bb72ccf8550eb95: start","job_status":"start","queue_duration_s":0.107167,"scheduling_latency_s":0.1072}1306gitlab # [ 161.304816] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"082e879d4bb72ccf8550eb95","created_at":"2026-10-02T16:55:07.173Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"31acecaf4e1c8050f7b96361232c3cfb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.218Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-082e879d4bb72ccf8550eb95: done: 0.077046 sec","job_status":"done","queue_duration_s":0.107167,"scheduling_latency_s":0.1072,"redis_calls":17,"redis_duration_s":0.018199,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.005947,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.010359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000401,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000311771,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.077046,"completed_at":"2026-10-02T16:55:07.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 161.350058] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"07e7ec705dcd23bb523f96ef","created_at":"2026-10-02T16:55:07.267Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7b4e0f7e460857dab1b7fac5f8a174c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.278Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-07e7ec705dcd23bb523f96ef: start","job_status":"start","queue_duration_s":0.168427,"scheduling_latency_s":0.168472}1308gitlab # [ 161.417748] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"07e7ec705dcd23bb523f96ef","created_at":"2026-10-02T16:55:07.267Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b7b4e0f7e460857dab1b7fac5f8a174c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.278Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-07e7ec705dcd23bb523f96ef: done: 0.068561 sec","job_status":"done","queue_duration_s":0.168427,"scheduling_latency_s":0.168472,"redis_calls":12,"redis_duration_s":0.021500000000000002,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00297,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001039518,"duration_s":0.068561,"completed_at":"2026-10-02T16:55:07.515Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 161.458568] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"708ae75ffdd97963cf5a5777","created_at":"2026-10-02T16:55:07.295Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9ac2913c52559a6f66297fd665a653c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.306Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-708ae75ffdd97963cf5a5777: start","job_status":"start","queue_duration_s":0.250317,"scheduling_latency_s":0.25035}1310gitlab # [ 161.553614] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"708ae75ffdd97963cf5a5777","created_at":"2026-10-02T16:55:07.295Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9ac2913c52559a6f66297fd665a653c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.306Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-708ae75ffdd97963cf5a5777: done: 0.094525 sec","job_status":"done","queue_duration_s":0.250317,"scheduling_latency_s":0.25035,"redis_calls":10,"redis_duration_s":0.014596,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001904,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001226413,"duration_s":0.094525,"completed_at":"2026-10-02T16:55:07.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 161.613512] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a92db7fc88c611c5ce48d771","created_at":"2026-10-02T16:55:07.315Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.327Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a92db7fc88c611c5ce48d771: start","job_status":"start","queue_duration_s":0.326803,"scheduling_latency_s":0.326833}1312gitlab # [ 161.674366] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a92db7fc88c611c5ce48d771","created_at":"2026-10-02T16:55:07.315Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.327Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a92db7fc88c611c5ce48d771: done: 0.117376 sec","job_status":"done","queue_duration_s":0.326803,"scheduling_latency_s":0.326833,"redis_calls":19,"redis_duration_s":0.032761,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003369,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001031,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.018294,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.010067,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000658464,"duration_s":0.117376,"completed_at":"2026-10-02T16:55:07.772Z","load_balancing_strategy":"primary","db_duration_s":0.030428,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 161.696264] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"10de5603c736fd243dcf7d6f","created_at":"2026-10-02T16:55:07.346Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b988380f3d0d8c584f6e15407bc920a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-02T16:55:07.374Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-10de5603c736fd243dcf7d6f: start","job_status":"start","queue_duration_s":0.400698,"scheduling_latency_s":0.400732}1314gitlab # [ 161.732854] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.830Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1315gitlab # [ 161.760098] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.857Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"10de5603c736fd243dcf7d6f","created_at":"2026-10-02T16:55:07.346Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4b988380f3d0d8c584f6e15407bc920a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-02T16:55:07.374Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-10de5603c736fd243dcf7d6f: done: 0.082678 sec","job_status":"done","queue_duration_s":0.400698,"scheduling_latency_s":0.400732,"redis_calls":10,"redis_duration_s":0.014237999999999999,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001427,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00968,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003131,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000835861,"duration_s":0.082678,"completed_at":"2026-10-02T16:55:07.857Z","load_balancing_strategy":"primary","db_duration_s":0.02876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 161.782100] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b20a212ea736357a3d9445e5","created_at":"2026-10-02T16:55:07.396Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8fe5dd2166fa566e7343b21bf63688c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.445Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b20a212ea736357a3d9445e5: start","job_status":"start","queue_duration_s":0.417073,"scheduling_latency_s":0.417093}1317gitlab # [ 161.782781] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.879Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1318gitlab # [ 161.787982] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"b20a212ea736357a3d9445e5","created_at":"2026-10-02T16:55:07.396Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8fe5dd2166fa566e7343b21bf63688c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.445Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-b20a212ea736357a3d9445e5: done: 0.023533 sec","job_status":"done","queue_duration_s":0.417073,"scheduling_latency_s":0.417093,"redis_calls":10,"redis_duration_s":0.006648,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001935,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000372394,"duration_s":0.023533,"completed_at":"2026-10-02T16:55:07.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 161.837059] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e8ffea402fc3a5921c429f70","created_at":"2026-10-02T16:55:07.478Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8531ce73d06e0215835909d9f612ac6c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.488Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e8ffea402fc3a5921c429f70: start","job_status":"start","queue_duration_s":0.398514,"scheduling_latency_s":0.39853}1320gitlab # [ 161.837782] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e8ffea402fc3a5921c429f70","created_at":"2026-10-02T16:55:07.478Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8531ce73d06e0215835909d9f612ac6c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.488Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e8ffea402fc3a5921c429f70: done: 0.019954 sec","job_status":"done","queue_duration_s":0.398514,"scheduling_latency_s":0.39853,"redis_calls":10,"redis_duration_s":0.001546,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000365,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000238298,"duration_s":0.019954,"completed_at":"2026-10-02T16:55:07.907Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 161.886061] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"93f9892d118b6581c663198d","created_at":"2026-10-02T16:55:07.501Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02a080f4be49da4bef038c5338425790","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.517Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-93f9892d118b6581c663198d: start","job_status":"start","queue_duration_s":0.390269,"scheduling_latency_s":0.390284}1322gitlab # [ 161.886853] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.915Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1323gitlab # [ 161.887656] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"93f9892d118b6581c663198d","created_at":"2026-10-02T16:55:07.501Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"02a080f4be49da4bef038c5338425790","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.517Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-93f9892d118b6581c663198d: done: 0.012313 sec","job_status":"done","queue_duration_s":0.390269,"scheduling_latency_s":0.390284,"redis_calls":10,"redis_duration_s":0.001536,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248914,"duration_s":0.012313,"completed_at":"2026-10-02T16:55:07.920Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000275,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 161.943193] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"630bf25d2f0b178de341371d","created_at":"2026-10-02T16:55:07.600Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a684a05cf1b810bf23389e78a9b5b36","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.619Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-630bf25d2f0b178de341371d: start","job_status":"start","queue_duration_s":0.301911,"scheduling_latency_s":0.301926}1325gitlab # [ 161.944097] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"630bf25d2f0b178de341371d","created_at":"2026-10-02T16:55:07.600Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a684a05cf1b810bf23389e78a9b5b36","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.619Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-630bf25d2f0b178de341371d: done: 0.023578 sec","job_status":"done","queue_duration_s":0.301911,"scheduling_latency_s":0.301926,"redis_calls":13,"redis_duration_s":0.001971,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.009704865,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.023578,"completed_at":"2026-10-02T16:55:07.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004954,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1326gitlab # [ 161.989966] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"8489362f3380ddaf349619f0","created_at":"2026-10-02T16:55:07.638Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"199f9c58cdc3bb601b58eb2537eca9e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-02T16:55:07.656Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-8489362f3380ddaf349619f0: start","job_status":"start","queue_duration_s":0.289615,"scheduling_latency_s":0.289629}1327gitlab # [ 162.036491] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"8489362f3380ddaf349619f0","created_at":"2026-10-02T16:55:07.638Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"199f9c58cdc3bb601b58eb2537eca9e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-02T16:55:07.656Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-8489362f3380ddaf349619f0: done: 0.020662 sec","job_status":"done","queue_duration_s":0.289615,"scheduling_latency_s":0.289629,"redis_calls":10,"redis_duration_s":0.001487,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022852,"duration_s":0.020662,"completed_at":"2026-10-02T16:55:07.966Z","load_balancing_strategy":"primary","db_duration_s":0.002681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 162.080987] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"53eeba0ada245e36c88b6ada","created_at":"2026-10-02T16:55:07.675Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97bf141699f1681ee61912a9343b2f52","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.690Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-53eeba0ada245e36c88b6ada: start","job_status":"start","queue_duration_s":0.277306,"scheduling_latency_s":0.27732}1329gitlab # [ 162.082048] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"53eeba0ada245e36c88b6ada","created_at":"2026-10-02T16:55:07.675Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"97bf141699f1681ee61912a9343b2f52","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.690Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-53eeba0ada245e36c88b6ada: done: 0.019138 sec","job_status":"done","queue_duration_s":0.277306,"scheduling_latency_s":0.27732,"redis_calls":10,"redis_duration_s":0.001558,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00031,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285791,"duration_s":0.019138,"completed_at":"2026-10-02T16:55:07.987Z","load_balancing_strategy":"primary","db_duration_s":0.004071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 162.094590] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:07.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"11562a2c0e4ea7d511934f30","created_at":"2026-10-02T16:55:07.700Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d41af8b611e577d84f013ede1145455c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.704Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-11562a2c0e4ea7d511934f30: start","job_status":"start","queue_duration_s":0.284089,"scheduling_latency_s":0.284104}1331gitlab # [ 162.144199] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"11562a2c0e4ea7d511934f30","created_at":"2026-10-02T16:55:07.700Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d41af8b611e577d84f013ede1145455c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.704Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-11562a2c0e4ea7d511934f30: done: 0.25405 sec","job_status":"done","queue_duration_s":0.284089,"scheduling_latency_s":0.284104,"redis_calls":565,"redis_duration_s":0.082391,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.081154,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286349,"duration_s":0.25405,"completed_at":"2026-10-02T16:55:08.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 162.149658] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8d52bcec2f2327e3bc155068","created_at":"2026-10-02T16:55:07.718Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16a39776999288c3bdea1769a0c1be54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.728Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8d52bcec2f2327e3bc155068: start","job_status":"start","queue_duration_s":0.514551,"scheduling_latency_s":0.514567}1333gitlab # [ 162.249054] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8d52bcec2f2327e3bc155068","created_at":"2026-10-02T16:55:07.718Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16a39776999288c3bdea1769a0c1be54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.728Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8d52bcec2f2327e3bc155068: done: 0.103291 sec","job_status":"done","queue_duration_s":0.514551,"scheduling_latency_s":0.514567,"redis_calls":14,"redis_duration_s":0.002563,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000364013,"exclusive_lock_hold_duration_s":0.082004835,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.103291,"completed_at":"2026-10-02T16:55:08.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.056996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 162.271601] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.348Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"551794adae072c6746cb5314","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-551794adae072c6746cb5314: start","job_status":"start","queue_duration_s":0.595006,"scheduling_latency_s":0.595033}1335gitlab # [ 162.272538] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.363Z","message":"No existing merge request to be cleaned up."}1336gitlab # [ 162.312764] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.410Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"551794adae072c6746cb5314","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-551794adae072c6746cb5314: done: 0.061893 sec","job_status":"done","queue_duration_s":0.595006,"scheduling_latency_s":0.595033,"redis_calls":13,"redis_duration_s":0.002565,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000347,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285232,"duration_s":0.061893,"completed_at":"2026-10-02T16:55:08.410Z","load_balancing_strategy":"primary","db_duration_s":0.037128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 162.351134] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.449Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27c4f1bbb8f04433716d96cb","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27c4f1bbb8f04433716d96cb: start","job_status":"start","queue_duration_s":0.695064,"scheduling_latency_s":0.695117}1338gitlab # [ 162.367062] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.465Z","message":"No existing merge request to be cleaned up."}1339gitlab # [ 162.377685] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.475Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27c4f1bbb8f04433716d96cb","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27c4f1bbb8f04433716d96cb: done: 0.02666 sec","job_status":"done","queue_duration_s":0.695064,"scheduling_latency_s":0.695117,"redis_calls":10,"redis_duration_s":0.00234,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02666,"completed_at":"2026-10-02T16:55:08.475Z","load_balancing_strategy":"primary","db_duration_s":0.002243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 162.413905] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.511Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"22235cace2c4c3b79db4d47b","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-22235cace2c4c3b79db4d47b: start","job_status":"start","queue_duration_s":0.757894,"scheduling_latency_s":0.757936}1341gitlab # [ 162.428822] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.527Z","message":"No existing merge request to be cleaned up."}1342gitlab # [ 162.439400] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.537Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"22235cace2c4c3b79db4d47b","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-22235cace2c4c3b79db4d47b: done: 0.025539 sec","job_status":"done","queue_duration_s":0.757894,"scheduling_latency_s":0.757936,"redis_calls":10,"redis_duration_s":0.0024619999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001505,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025539,"completed_at":"2026-10-02T16:55:08.537Z","load_balancing_strategy":"primary","db_duration_s":0.002529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 162.476876] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.574Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a64d9d80769400210c7e0db6","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a64d9d80769400210c7e0db6: start","job_status":"start","queue_duration_s":0.820949,"scheduling_latency_s":0.820981}1344gitlab # [ 162.488670] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.586Z","message":"No existing merge request to be cleaned up."}1345gitlab # [ 162.495616] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.593Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a64d9d80769400210c7e0db6","created_at":"2026-10-02T16:55:07.722Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-1ecabb621b144cdb","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"06c007db622151e24fe289f9635b7273","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.753Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a64d9d80769400210c7e0db6: done: 0.018999 sec","job_status":"done","queue_duration_s":0.820949,"scheduling_latency_s":0.820981,"redis_calls":10,"redis_duration_s":0.002388,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001377,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018999,"completed_at":"2026-10-02T16:55:08.593Z","load_balancing_strategy":"primary","db_duration_s":0.002409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 162.532166] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7ac3eb7a72c14c73ab74e30e","created_at":"2026-10-02T16:55:07.742Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99508c48121eee952492d28508e82a74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.757Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7ac3eb7a72c14c73ab74e30e: start","job_status":"start","queue_duration_s":0.87251,"scheduling_latency_s":0.872536}1347gitlab # [ 162.686599] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7ac3eb7a72c14c73ab74e30e","created_at":"2026-10-02T16:55:07.742Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99508c48121eee952492d28508e82a74","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.757Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7ac3eb7a72c14c73ab74e30e: done: 0.154467 sec","job_status":"done","queue_duration_s":0.87251,"scheduling_latency_s":0.872536,"redis_calls":12,"redis_duration_s":0.003623,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001004318,"exclusive_lock_hold_duration_s":0.135738201,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.154467,"completed_at":"2026-10-02T16:55:08.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.05034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 162.757400] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"78fd0205f5693584bee00b61","created_at":"2026-10-02T16:55:07.769Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.780Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-78fd0205f5693584bee00b61: start","job_status":"start","queue_duration_s":1.07523,"scheduling_latency_s":1.075263}1349gitlab # [ 162.819669] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.917Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"78fd0205f5693584bee00b61","created_at":"2026-10-02T16:55:07.769Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.780Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-78fd0205f5693584bee00b61: done: 0.062406 sec","job_status":"done","queue_duration_s":1.07523,"scheduling_latency_s":1.075263,"redis_calls":28,"redis_duration_s":0.0069229999999999995,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001058,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000493,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.003606,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000307022,"duration_s":0.062406,"completed_at":"2026-10-02T16:55:08.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 162.880177] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:08.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8354cc0bf6937728ca66f4ad","created_at":"2026-10-02T16:55:07.798Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.804Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8354cc0bf6937728ca66f4ad: start","job_status":"start","queue_duration_s":1.173274,"scheduling_latency_s":1.173325}1351gitlab # [ 162.979229] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.077Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8354cc0bf6937728ca66f4ad","created_at":"2026-10-02T16:55:07.798Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.804Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8354cc0bf6937728ca66f4ad: done: 0.099236 sec","job_status":"done","queue_duration_s":1.173274,"scheduling_latency_s":1.173325,"redis_calls":71,"redis_duration_s":0.019039,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003074,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001084,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.014016,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342502,"duration_s":0.099236,"completed_at":"2026-10-02T16:55:09.077Z","load_balancing_strategy":"primary","db_duration_s":0.001934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 163.049749] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.147Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8bdc3fa595e4682c7cdb0f55","created_at":"2026-10-02T16:55:07.808Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3fd92e1270d0219c20d8c02ad1783b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.811Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8bdc3fa595e4682c7cdb0f55: start","job_status":"start","queue_duration_s":1.335827,"scheduling_latency_s":1.335862}1353gitlab # [ 163.059157] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.157Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1354gitlab # [ 163.072712] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8bdc3fa595e4682c7cdb0f55","created_at":"2026-10-02T16:55:07.808Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3fd92e1270d0219c20d8c02ad1783b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.811Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8bdc3fa595e4682c7cdb0f55: done: 0.023254 sec","job_status":"done","queue_duration_s":1.335827,"scheduling_latency_s":1.335862,"redis_calls":10,"redis_duration_s":0.002852,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000472,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00182,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063332,"duration_s":0.023254,"completed_at":"2026-10-02T16:55:09.170Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 163.112788] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2a125bb43d04153f1d959a71","created_at":"2026-10-02T16:55:07.813Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a55919618ff84fb97b5f2ff01b602eb6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.816Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2a125bb43d04153f1d959a71: start","job_status":"start","queue_duration_s":1.394071,"scheduling_latency_s":1.394113}1356gitlab # [ 163.168733] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2a125bb43d04153f1d959a71","created_at":"2026-10-02T16:55:07.813Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a55919618ff84fb97b5f2ff01b602eb6","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.816Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2a125bb43d04153f1d959a71: done: 0.055829 sec","job_status":"done","queue_duration_s":1.394071,"scheduling_latency_s":1.394113,"redis_calls":10,"redis_duration_s":0.003442,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000765,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001997,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00068,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000457041,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.055829,"completed_at":"2026-10-02T16:55:09.266Z","load_balancing_strategy":"primary","db_duration_s":0.020099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 163.213398] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e86b9551eeeddd6aad043e67","created_at":"2026-10-02T16:55:07.818Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"086d910c5e4da597248d7ea09e2c0838","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.820Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e86b9551eeeddd6aad043e67: start","job_status":"start","queue_duration_s":1.490052,"scheduling_latency_s":1.490107}1358gitlab # [ 163.280239] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.377Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e86b9551eeeddd6aad043e67","created_at":"2026-10-02T16:55:07.818Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"086d910c5e4da597248d7ea09e2c0838","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.820Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e86b9551eeeddd6aad043e67: done: 0.066852 sec","job_status":"done","queue_duration_s":1.490052,"scheduling_latency_s":1.490107,"redis_calls":12,"redis_duration_s":0.003745,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000688,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001343,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001185626,"exclusive_lock_hold_duration_s":0.017141563999999998,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.066852,"completed_at":"2026-10-02T16:55:09.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 163.330152] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.427Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2b639a30012a99a1f301b02e","created_at":"2026-10-02T16:55:07.825Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3896d85b223b28caa760714b87c0231f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.833Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2b639a30012a99a1f301b02e: start","job_status":"start","queue_duration_s":1.594367,"scheduling_latency_s":1.594424}1360gitlab # [ 163.369977] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"2b639a30012a99a1f301b02e","created_at":"2026-10-02T16:55:07.825Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3896d85b223b28caa760714b87c0231f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.833Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-2b639a30012a99a1f301b02e: done: 0.040129 sec","job_status":"done","queue_duration_s":1.594367,"scheduling_latency_s":1.594424,"redis_calls":10,"redis_duration_s":0.003486,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00212,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000718,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000498667,"duration_s":0.040129,"completed_at":"2026-10-02T16:55:09.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 163.410194] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.508Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"21c4f53632163fc6ba497fe8","created_at":"2026-10-02T16:55:07.856Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c7217be7c1b896fed82ab66f2b74150","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.864Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-21c4f53632163fc6ba497fe8: start","job_status":"start","queue_duration_s":1.643162,"scheduling_latency_s":1.643213}1362gitlab # [ 163.448388] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.546Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"21c4f53632163fc6ba497fe8","created_at":"2026-10-02T16:55:07.856Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-4a05da831bdb42e5","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c7217be7c1b896fed82ab66f2b74150","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:07.864Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-21c4f53632163fc6ba497fe8: done: 0.03822 sec","job_status":"done","queue_duration_s":1.643162,"scheduling_latency_s":1.643213,"redis_calls":12,"redis_duration_s":0.004079,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001466,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000760152,"exclusive_lock_hold_duration_s":0.009025169,"duration_s":0.03822,"completed_at":"2026-10-02T16:55:09.545Z","load_balancing_strategy":"primary","db_duration_s":0.004844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 163.488794] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"945ae7ad85fb1b6eb105f6c1","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-945ae7ad85fb1b6eb105f6c1: start","job_status":"start","queue_duration_s":0.675261,"scheduling_latency_s":0.675369}1364gitlab # [ 163.512280] setup-gitlab-start[2227]: W, [2026-10-02T16:55:09.609855 #2227] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1365gitlab # [ 163.556849] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"945ae7ad85fb1b6eb105f6c1","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-945ae7ad85fb1b6eb105f6c1: done: 0.068002 sec","job_status":"done","queue_duration_s":0.675261,"scheduling_latency_s":0.675369,"redis_calls":16,"redis_duration_s":0.005483,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000997,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002939,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000573816,"duration_s":0.068002,"completed_at":"2026-10-02T16:55:09.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017943,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 163.609152] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c88ee8d2a249eff2659e4853","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c88ee8d2a249eff2659e4853: start","job_status":"start","queue_duration_s":0.795697,"scheduling_latency_s":0.795752}1367gitlab # [ 163.639782] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c88ee8d2a249eff2659e4853","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c88ee8d2a249eff2659e4853: done: 0.030725 sec","job_status":"done","queue_duration_s":0.795697,"scheduling_latency_s":0.795752,"redis_calls":13,"redis_duration_s":0.004653,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001458,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030725,"completed_at":"2026-10-02T16:55:09.737Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 163.681374] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"41cbfd10539531628186083c","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-41cbfd10539531628186083c: start","job_status":"start","queue_duration_s":0.86799,"scheduling_latency_s":0.868035}1369gitlab # [ 163.719650] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"41cbfd10539531628186083c","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-41cbfd10539531628186083c: done: 0.038202 sec","job_status":"done","queue_duration_s":0.86799,"scheduling_latency_s":0.868035,"redis_calls":13,"redis_duration_s":0.008476,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038202,"completed_at":"2026-10-02T16:55:09.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370gitlab # [ 163.757549] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8dd190e4f59f45b685046900","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8dd190e4f59f45b685046900: start","job_status":"start","queue_duration_s":0.944171,"scheduling_latency_s":0.944214}1371gitlab # [ 163.794690] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8dd190e4f59f45b685046900","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8dd190e4f59f45b685046900: done: 0.036993 sec","job_status":"done","queue_duration_s":0.944171,"scheduling_latency_s":0.944214,"redis_calls":13,"redis_duration_s":0.0029170000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036993,"completed_at":"2026-10-02T16:55:09.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372gitlab # [ 163.832596] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4f787ef08425bd6ae0fe2632","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4f787ef08425bd6ae0fe2632: start","job_status":"start","queue_duration_s":1.018966,"scheduling_latency_s":1.019019}1373gitlab # [ 163.860363] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4f787ef08425bd6ae0fe2632","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4f787ef08425bd6ae0fe2632: done: 0.028013 sec","job_status":"done","queue_duration_s":1.018966,"scheduling_latency_s":1.019019,"redis_calls":13,"redis_duration_s":0.004479,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001692,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028013,"completed_at":"2026-10-02T16:55:09.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 163.899087] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:09.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b275da04e2e064c04af76130","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b275da04e2e064c04af76130: start","job_status":"start","queue_duration_s":1.085579,"scheduling_latency_s":1.085643}1375gitlab # [ 163.930156] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b275da04e2e064c04af76130","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b275da04e2e064c04af76130: done: 0.03121 sec","job_status":"done","queue_duration_s":1.085579,"scheduling_latency_s":1.085643,"redis_calls":13,"redis_duration_s":0.0043549999999999995,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03121,"completed_at":"2026-10-02T16:55:10.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 163.967955] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2b949a76f898e191d64cc07d","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2b949a76f898e191d64cc07d: start","job_status":"start","queue_duration_s":1.154693,"scheduling_latency_s":1.154735}1377gitlab # [ 164.004139] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2b949a76f898e191d64cc07d","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2b949a76f898e191d64cc07d: done: 0.036212 sec","job_status":"done","queue_duration_s":1.154693,"scheduling_latency_s":1.154735,"redis_calls":13,"redis_duration_s":0.003059,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036212,"completed_at":"2026-10-02T16:55:10.101Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 164.043535] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7051eab42f89cc467c3acc66","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7051eab42f89cc467c3acc66: start","job_status":"start","queue_duration_s":1.230129,"scheduling_latency_s":1.230171}1379gitlab # [ 164.082963] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7051eab42f89cc467c3acc66","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7051eab42f89cc467c3acc66: done: 0.038645 sec","job_status":"done","queue_duration_s":1.230129,"scheduling_latency_s":1.230171,"redis_calls":13,"redis_duration_s":0.003766,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002469,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038645,"completed_at":"2026-10-02T16:55:10.179Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 164.120703] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2a8f259bef7f71cca9844f1f","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2a8f259bef7f71cca9844f1f: start","job_status":"start","queue_duration_s":1.306977,"scheduling_latency_s":1.307027}1381gitlab # [ 164.149205] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2a8f259bef7f71cca9844f1f","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2a8f259bef7f71cca9844f1f: done: 0.028839 sec","job_status":"done","queue_duration_s":1.306977,"scheduling_latency_s":1.307027,"redis_calls":13,"redis_duration_s":0.00437,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001478,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028839,"completed_at":"2026-10-02T16:55:10.246Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 164.192143] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5a9339ff6b140fabc098cd89","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5a9339ff6b140fabc098cd89: start","job_status":"start","queue_duration_s":1.378714,"scheduling_latency_s":1.378767}1383gitlab # [ 164.239381] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"5a9339ff6b140fabc098cd89","created_at":"2026-10-02T16:55:08.895Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-6184c2ff6d584f99","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"9aed15c7f9f424b65e9b9e0b4044a3cc","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:08.911Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-5a9339ff6b140fabc098cd89: done: 0.047405 sec","job_status":"done","queue_duration_s":1.378714,"scheduling_latency_s":1.378767,"redis_calls":13,"redis_duration_s":0.006081,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00398,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047405,"completed_at":"2026-10-02T16:55:10.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 164.262284] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"133da32d2db885a05d9021e4","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-133da32d2db885a05d9021e4: start","job_status":"start","queue_duration_s":1.26941,"scheduling_latency_s":1.269437}1385gitlab # [ 164.295970] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"133da32d2db885a05d9021e4","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-133da32d2db885a05d9021e4: done: 0.05444 sec","job_status":"done","queue_duration_s":1.26941,"scheduling_latency_s":1.269437,"redis_calls":16,"redis_duration_s":0.03053,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000669,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027286,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002575,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000450337,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05444,"completed_at":"2026-10-02T16:55:10.393Z","load_balancing_strategy":"primary","db_duration_s":0.000647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 164.334584] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c454b8cd2e0cc5d9aaff5629","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c454b8cd2e0cc5d9aaff5629: start","job_status":"start","queue_duration_s":1.36232,"scheduling_latency_s":1.362363}1387gitlab # [ 164.368335] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c454b8cd2e0cc5d9aaff5629","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c454b8cd2e0cc5d9aaff5629: done: 0.033789 sec","job_status":"done","queue_duration_s":1.36232,"scheduling_latency_s":1.362363,"redis_calls":13,"redis_duration_s":0.002975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033789,"completed_at":"2026-10-02T16:55:10.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 164.405616] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3561ce818d0c761386a0c7ed","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3561ce818d0c761386a0c7ed: start","job_status":"start","queue_duration_s":1.433354,"scheduling_latency_s":1.433398}1389gitlab # [ 164.431218] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3561ce818d0c761386a0c7ed","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3561ce818d0c761386a0c7ed: done: 0.025788 sec","job_status":"done","queue_duration_s":1.433354,"scheduling_latency_s":1.433398,"redis_calls":13,"redis_duration_s":0.003981,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025788,"completed_at":"2026-10-02T16:55:10.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 164.468506] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec036f809511a1a2a9ca2df5","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec036f809511a1a2a9ca2df5: start","job_status":"start","queue_duration_s":1.496363,"scheduling_latency_s":1.496406}1391gitlab # [ 164.537162] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec036f809511a1a2a9ca2df5","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec036f809511a1a2a9ca2df5: done: 0.068956 sec","job_status":"done","queue_duration_s":1.496363,"scheduling_latency_s":1.496406,"redis_calls":13,"redis_duration_s":0.003173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.068956,"completed_at":"2026-10-02T16:55:10.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 164.595450] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d75c3686861831cee5e77f2","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d75c3686861831cee5e77f2: start","job_status":"start","queue_duration_s":1.623306,"scheduling_latency_s":1.623349}1393gitlab # [ 164.616873] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d75c3686861831cee5e77f2","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d75c3686861831cee5e77f2: done: 0.021767 sec","job_status":"done","queue_duration_s":1.623306,"scheduling_latency_s":1.623349,"redis_calls":13,"redis_duration_s":0.003637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002517,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021767,"completed_at":"2026-10-02T16:55:10.714Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 164.654334] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e40041c82712fc4efee6bcd2","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e40041c82712fc4efee6bcd2: start","job_status":"start","queue_duration_s":1.68218,"scheduling_latency_s":1.682217}1395gitlab # [ 164.683152] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e40041c82712fc4efee6bcd2","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e40041c82712fc4efee6bcd2: done: 0.02877 sec","job_status":"done","queue_duration_s":1.68218,"scheduling_latency_s":1.682217,"redis_calls":13,"redis_duration_s":0.0059039999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003277,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02877,"completed_at":"2026-10-02T16:55:10.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 164.722176] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c38769c2a0059d3eb745354d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c38769c2a0059d3eb745354d: start","job_status":"start","queue_duration_s":1.748423,"scheduling_latency_s":1.748464}1397gitlab # [ 164.745874] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c38769c2a0059d3eb745354d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c38769c2a0059d3eb745354d: done: 0.02533 sec","job_status":"done","queue_duration_s":1.748423,"scheduling_latency_s":1.748464,"redis_calls":13,"redis_duration_s":0.004142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002334,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02533,"completed_at":"2026-10-02T16:55:10.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 164.768946] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc3e557e744c37b635aa063b","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc3e557e744c37b635aa063b: start","job_status":"start","queue_duration_s":1.77633,"scheduling_latency_s":1.776356}1399gitlab # [ 164.769838] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc3e557e744c37b635aa063b","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc3e557e744c37b635aa063b: done: 0.015383 sec","job_status":"done","queue_duration_s":1.77633,"scheduling_latency_s":1.776356,"redis_calls":13,"redis_duration_s":0.002999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015383,"completed_at":"2026-10-02T16:55:10.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 164.791331] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903c11d69f3551596f836037","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903c11d69f3551596f836037: start","job_status":"start","queue_duration_s":1.793644,"scheduling_latency_s":1.793658}1401gitlab # [ 164.854529] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"903c11d69f3551596f836037","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-903c11d69f3551596f836037: done: 0.088886 sec","job_status":"done","queue_duration_s":1.793644,"scheduling_latency_s":1.793658,"redis_calls":13,"redis_duration_s":0.077141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.075886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.088886,"completed_at":"2026-10-02T16:55:10.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 164.892125] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:10.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"239dea836b7e32b51abba811","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-239dea836b7e32b51abba811: start","job_status":"start","queue_duration_s":1.920039,"scheduling_latency_s":1.920082}1403gitlab # [ 164.916552] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"239dea836b7e32b51abba811","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-239dea836b7e32b51abba811: done: 0.024323 sec","job_status":"done","queue_duration_s":1.920039,"scheduling_latency_s":1.920082,"redis_calls":13,"redis_duration_s":0.0048070000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001347,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00346,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024323,"completed_at":"2026-10-02T16:55:11.014Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 164.954503] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46719e5294a6caaf6e9897ff","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46719e5294a6caaf6e9897ff: start","job_status":"start","queue_duration_s":1.982335,"scheduling_latency_s":1.982372}1405gitlab # [ 164.990609] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46719e5294a6caaf6e9897ff","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46719e5294a6caaf6e9897ff: done: 0.036029 sec","job_status":"done","queue_duration_s":1.982335,"scheduling_latency_s":1.982372,"redis_calls":13,"redis_duration_s":0.0038719999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002606,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036029,"completed_at":"2026-10-02T16:55:11.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 165.028238] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.126Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e1e016faf8f680604fadce","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e1e016faf8f680604fadce: start","job_status":"start","queue_duration_s":2.056095,"scheduling_latency_s":2.056135}1407gitlab # [ 165.059818] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e1e016faf8f680604fadce","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e1e016faf8f680604fadce: done: 0.030887 sec","job_status":"done","queue_duration_s":2.056095,"scheduling_latency_s":2.056135,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030887,"completed_at":"2026-10-02T16:55:11.156Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 165.098090] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a2966384395aa83a54dfe4","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a2966384395aa83a54dfe4: start","job_status":"start","queue_duration_s":2.125247,"scheduling_latency_s":2.125291}1409gitlab # [ 165.120958] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.218Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a2966384395aa83a54dfe4","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a2966384395aa83a54dfe4: done: 0.023635 sec","job_status":"done","queue_duration_s":2.125247,"scheduling_latency_s":2.125291,"redis_calls":13,"redis_duration_s":0.004587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001306,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003281,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014843,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023635,"completed_at":"2026-10-02T16:55:11.218Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 165.158740] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4c5898ef9c9e1ec73b10552","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4c5898ef9c9e1ec73b10552: start","job_status":"start","queue_duration_s":2.186697,"scheduling_latency_s":2.186731}1411gitlab # [ 165.200068] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4c5898ef9c9e1ec73b10552","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4c5898ef9c9e1ec73b10552: done: 0.041076 sec","job_status":"done","queue_duration_s":2.186697,"scheduling_latency_s":2.186731,"redis_calls":13,"redis_duration_s":0.004265,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00285,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041076,"completed_at":"2026-10-02T16:55:11.297Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 165.237956] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01db2b0470addee04214525e","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01db2b0470addee04214525e: start","job_status":"start","queue_duration_s":2.265735,"scheduling_latency_s":2.265778}1413gitlab # [ 165.263727] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01db2b0470addee04214525e","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01db2b0470addee04214525e: done: 0.025983 sec","job_status":"done","queue_duration_s":2.265735,"scheduling_latency_s":2.265778,"redis_calls":13,"redis_duration_s":0.0037600000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002546,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025983,"completed_at":"2026-10-02T16:55:11.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 165.302187] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32e92fe6985307963f1c7edf","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32e92fe6985307963f1c7edf: start","job_status":"start","queue_duration_s":2.328898,"scheduling_latency_s":2.328937}1415gitlab # [ 165.336549] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"32e92fe6985307963f1c7edf","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-32e92fe6985307963f1c7edf: done: 0.034577 sec","job_status":"done","queue_duration_s":2.328898,"scheduling_latency_s":2.328937,"redis_calls":13,"redis_duration_s":0.0029259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034577,"completed_at":"2026-10-02T16:55:11.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 165.375565] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"decc037640476a376fb5e05a","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-decc037640476a376fb5e05a: start","job_status":"start","queue_duration_s":2.403255,"scheduling_latency_s":2.403309}1417gitlab # [ 165.402130] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"decc037640476a376fb5e05a","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-decc037640476a376fb5e05a: done: 0.026773 sec","job_status":"done","queue_duration_s":2.403255,"scheduling_latency_s":2.403309,"redis_calls":13,"redis_duration_s":0.00396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026773,"completed_at":"2026-10-02T16:55:11.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 165.440423] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebde2a230cec6d7868fc57c8","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebde2a230cec6d7868fc57c8: start","job_status":"start","queue_duration_s":2.468135,"scheduling_latency_s":2.468187}1419gitlab # [ 165.465432] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebde2a230cec6d7868fc57c8","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebde2a230cec6d7868fc57c8: done: 0.025197 sec","job_status":"done","queue_duration_s":2.468135,"scheduling_latency_s":2.468187,"redis_calls":13,"redis_duration_s":0.003946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001333,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002613,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025197,"completed_at":"2026-10-02T16:55:11.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 165.503184] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf475bfd515b42db5758d857","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf475bfd515b42db5758d857: start","job_status":"start","queue_duration_s":2.530834,"scheduling_latency_s":2.530875}1421gitlab # [ 165.535070] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf475bfd515b42db5758d857","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf475bfd515b42db5758d857: done: 0.031977 sec","job_status":"done","queue_duration_s":2.530834,"scheduling_latency_s":2.530875,"redis_calls":13,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001806,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031977,"completed_at":"2026-10-02T16:55:11.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 165.573878] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7e81d8f337c9097f14caa32","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7e81d8f337c9097f14caa32: start","job_status":"start","queue_duration_s":2.601039,"scheduling_latency_s":2.601083}1423gitlab # [ 165.600591] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f7e81d8f337c9097f14caa32","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f7e81d8f337c9097f14caa32: done: 0.027413 sec","job_status":"done","queue_duration_s":2.601039,"scheduling_latency_s":2.601083,"redis_calls":15,"redis_duration_s":0.004365,"redis_read_bytes":172,"redis_write_bytes":1250,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":162,"redis_feature_flag_write_bytes":93,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002553,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027413,"completed_at":"2026-10-02T16:55:11.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 165.639903] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f9960c4629e43faab93496d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f9960c4629e43faab93496d: start","job_status":"start","queue_duration_s":2.667867,"scheduling_latency_s":2.667907}1425gitlab # [ 165.672399] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f9960c4629e43faab93496d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f9960c4629e43faab93496d: done: 0.032396 sec","job_status":"done","queue_duration_s":2.667867,"scheduling_latency_s":2.667907,"redis_calls":13,"redis_duration_s":0.002738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032396,"completed_at":"2026-10-02T16:55:11.770Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 165.711082] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed2fadc80fab81644e78922d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed2fadc80fab81644e78922d: start","job_status":"start","queue_duration_s":2.738844,"scheduling_latency_s":2.738895}1427gitlab # [ 165.736328] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed2fadc80fab81644e78922d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed2fadc80fab81644e78922d: done: 0.025318 sec","job_status":"done","queue_duration_s":2.738844,"scheduling_latency_s":2.738895,"redis_calls":13,"redis_duration_s":0.003941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001351,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025318,"completed_at":"2026-10-02T16:55:11.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 165.777262] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b76b5a26a966dd11f3be86fb","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b76b5a26a966dd11f3be86fb: start","job_status":"start","queue_duration_s":2.803874,"scheduling_latency_s":2.803926}1429gitlab # [ 165.811199] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b76b5a26a966dd11f3be86fb","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b76b5a26a966dd11f3be86fb: done: 0.034509 sec","job_status":"done","queue_duration_s":2.803874,"scheduling_latency_s":2.803926,"redis_calls":13,"redis_duration_s":0.0038569999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002616,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034509,"completed_at":"2026-10-02T16:55:11.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 165.849418] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5311154b5a17129029ce57a6","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5311154b5a17129029ce57a6: start","job_status":"start","queue_duration_s":2.877166,"scheduling_latency_s":2.877214}1431gitlab # [ 165.874508] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:11.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5311154b5a17129029ce57a6","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5311154b5a17129029ce57a6: done: 0.02523 sec","job_status":"done","queue_duration_s":2.877166,"scheduling_latency_s":2.877214,"redis_calls":13,"redis_duration_s":0.0038659999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002568,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02523,"completed_at":"2026-10-02T16:55:11.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 165.911782] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edca206611944baa7c3feba1","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edca206611944baa7c3feba1: start","job_status":"start","queue_duration_s":2.939484,"scheduling_latency_s":2.939588}1433gitlab # [ 165.947171] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edca206611944baa7c3feba1","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edca206611944baa7c3feba1: done: 0.035476 sec","job_status":"done","queue_duration_s":2.939484,"scheduling_latency_s":2.939588,"redis_calls":13,"redis_duration_s":0.0041919999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035476,"completed_at":"2026-10-02T16:55:12.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 165.987304] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3881c7ad715cb2738498213","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3881c7ad715cb2738498213: start","job_status":"start","queue_duration_s":3.015056,"scheduling_latency_s":3.015103}1435gitlab # [ 166.012055] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3881c7ad715cb2738498213","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3881c7ad715cb2738498213: done: 0.024871 sec","job_status":"done","queue_duration_s":3.015056,"scheduling_latency_s":3.015103,"redis_calls":13,"redis_duration_s":0.003833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002598,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024871,"completed_at":"2026-10-02T16:55:12.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 166.050551] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0c280943782bde43c7fb218","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0c280943782bde43c7fb218: start","job_status":"start","queue_duration_s":3.078153,"scheduling_latency_s":3.078206}1437gitlab # [ 166.075953] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0c280943782bde43c7fb218","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0c280943782bde43c7fb218: done: 0.024793 sec","job_status":"done","queue_duration_s":3.078153,"scheduling_latency_s":3.078206,"redis_calls":13,"redis_duration_s":0.003981,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024793,"completed_at":"2026-10-02T16:55:12.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 166.115164] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"362724f80b5b05e90d9c8807","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-362724f80b5b05e90d9c8807: start","job_status":"start","queue_duration_s":3.142191,"scheduling_latency_s":3.142242}1439gitlab # [ 166.140996] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"362724f80b5b05e90d9c8807","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-362724f80b5b05e90d9c8807: done: 0.026669 sec","job_status":"done","queue_duration_s":3.142191,"scheduling_latency_s":3.142242,"redis_calls":13,"redis_duration_s":0.004246,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026669,"completed_at":"2026-10-02T16:55:12.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 166.178592] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42158ec89ba388422dc5f03","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42158ec89ba388422dc5f03: start","job_status":"start","queue_duration_s":3.206351,"scheduling_latency_s":3.206396}1441gitlab # [ 166.202983] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a42158ec89ba388422dc5f03","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a42158ec89ba388422dc5f03: done: 0.024576 sec","job_status":"done","queue_duration_s":3.206351,"scheduling_latency_s":3.206396,"redis_calls":13,"redis_duration_s":0.004657,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003395,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024576,"completed_at":"2026-10-02T16:55:12.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 166.241259] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c60f1acbec894da5b48e89db","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c60f1acbec894da5b48e89db: start","job_status":"start","queue_duration_s":3.268432,"scheduling_latency_s":3.268474}1443gitlab # [ 166.273092] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c60f1acbec894da5b48e89db","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c60f1acbec894da5b48e89db: done: 0.032478 sec","job_status":"done","queue_duration_s":3.268432,"scheduling_latency_s":3.268474,"redis_calls":13,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032478,"completed_at":"2026-10-02T16:55:12.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 166.311688] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e564223c400e0e706f3f401","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e564223c400e0e706f3f401: start","job_status":"start","queue_duration_s":3.33927,"scheduling_latency_s":3.339322}1445gitlab # [ 166.336518] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e564223c400e0e706f3f401","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e564223c400e0e706f3f401: done: 0.025138 sec","job_status":"done","queue_duration_s":3.33927,"scheduling_latency_s":3.339322,"redis_calls":13,"redis_duration_s":0.003898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001362,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002536,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025138,"completed_at":"2026-10-02T16:55:12.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 166.374837] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae256c0d8930dc0ad6875742","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae256c0d8930dc0ad6875742: start","job_status":"start","queue_duration_s":3.402623,"scheduling_latency_s":3.402674}1447gitlab # [ 166.400569] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae256c0d8930dc0ad6875742","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae256c0d8930dc0ad6875742: done: 0.025897 sec","job_status":"done","queue_duration_s":3.402623,"scheduling_latency_s":3.402674,"redis_calls":13,"redis_duration_s":0.003885,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002608,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025897,"completed_at":"2026-10-02T16:55:12.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 166.438140] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0a8af8922d2b9134254c02","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0a8af8922d2b9134254c02: start","job_status":"start","queue_duration_s":3.465929,"scheduling_latency_s":3.466014}1449gitlab # [ 166.470859] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c0a8af8922d2b9134254c02","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c0a8af8922d2b9134254c02: done: 0.031913 sec","job_status":"done","queue_duration_s":3.465929,"scheduling_latency_s":3.466014,"redis_calls":13,"redis_duration_s":0.002716,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031913,"completed_at":"2026-10-02T16:55:12.567Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 166.507466] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f910ee078927baa58df608c4","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f910ee078927baa58df608c4: start","job_status":"start","queue_duration_s":3.535312,"scheduling_latency_s":3.535355}1451gitlab # [ 166.539882] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f910ee078927baa58df608c4","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f910ee078927baa58df608c4: done: 0.032318 sec","job_status":"done","queue_duration_s":3.535312,"scheduling_latency_s":3.535355,"redis_calls":13,"redis_duration_s":0.0028320000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032318,"completed_at":"2026-10-02T16:55:12.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 166.577477] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fdb7407bc00fc6a9c9829b8","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fdb7407bc00fc6a9c9829b8: start","job_status":"start","queue_duration_s":3.604972,"scheduling_latency_s":3.605025}1453gitlab # [ 166.609738] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fdb7407bc00fc6a9c9829b8","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fdb7407bc00fc6a9c9829b8: done: 0.03254 sec","job_status":"done","queue_duration_s":3.604972,"scheduling_latency_s":3.605025,"redis_calls":13,"redis_duration_s":0.002468,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000886,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001582,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03254,"completed_at":"2026-10-02T16:55:12.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 166.646697] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df5314210c438a9ed32be03d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df5314210c438a9ed32be03d: start","job_status":"start","queue_duration_s":3.674606,"scheduling_latency_s":3.674646}1455gitlab # [ 166.679974] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df5314210c438a9ed32be03d","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df5314210c438a9ed32be03d: done: 0.033334 sec","job_status":"done","queue_duration_s":3.674606,"scheduling_latency_s":3.674646,"redis_calls":13,"redis_duration_s":0.003993,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033334,"completed_at":"2026-10-02T16:55:12.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 166.717483] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8c245d4c12cce64d0dcc547","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8c245d4c12cce64d0dcc547: start","job_status":"start","queue_duration_s":3.745378,"scheduling_latency_s":3.745418}1457gitlab # [ 166.748333] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8c245d4c12cce64d0dcc547","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8c245d4c12cce64d0dcc547: done: 0.030093 sec","job_status":"done","queue_duration_s":3.745378,"scheduling_latency_s":3.745418,"redis_calls":13,"redis_duration_s":0.002384,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030093,"completed_at":"2026-10-02T16:55:12.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 166.787242] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f38e7d00ece60d578c80cbf","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f38e7d00ece60d578c80cbf: start","job_status":"start","queue_duration_s":3.813217,"scheduling_latency_s":3.813245}1459gitlab # [ 166.818331] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f38e7d00ece60d578c80cbf","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f38e7d00ece60d578c80cbf: done: 0.032931 sec","job_status":"done","queue_duration_s":3.813217,"scheduling_latency_s":3.813245,"redis_calls":13,"redis_duration_s":0.003255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002421,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032931,"completed_at":"2026-10-02T16:55:12.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 166.855727] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d87980762f5850c62ee0fc6","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d87980762f5850c62ee0fc6: start","job_status":"start","queue_duration_s":3.883437,"scheduling_latency_s":3.88348}1461gitlab # [ 166.887217] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:12.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d87980762f5850c62ee0fc6","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d87980762f5850c62ee0fc6: done: 0.031546 sec","job_status":"done","queue_duration_s":3.883437,"scheduling_latency_s":3.88348,"redis_calls":13,"redis_duration_s":0.002431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000795,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001636,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031546,"completed_at":"2026-10-02T16:55:12.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 166.923830] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cbeee59fdacca0aac117919","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cbeee59fdacca0aac117919: start","job_status":"start","queue_duration_s":3.951844,"scheduling_latency_s":3.951872}1463gitlab # [ 166.957480] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cbeee59fdacca0aac117919","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cbeee59fdacca0aac117919: done: 0.032892 sec","job_status":"done","queue_duration_s":3.951844,"scheduling_latency_s":3.951872,"redis_calls":13,"redis_duration_s":0.002478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001609,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032892,"completed_at":"2026-10-02T16:55:13.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 166.993543] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d576f39c1b1179ded36c5864","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d576f39c1b1179ded36c5864: start","job_status":"start","queue_duration_s":4.021572,"scheduling_latency_s":4.021597}1465gitlab # [ 167.027161] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d576f39c1b1179ded36c5864","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d576f39c1b1179ded36c5864: done: 0.033263 sec","job_status":"done","queue_duration_s":4.021572,"scheduling_latency_s":4.021597,"redis_calls":13,"redis_duration_s":0.002631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001543,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033263,"completed_at":"2026-10-02T16:55:13.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 167.063917] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"753a5d2bcd74dc1d532cbbda","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-753a5d2bcd74dc1d532cbbda: start","job_status":"start","queue_duration_s":4.09176,"scheduling_latency_s":4.091815}1467gitlab # [ 167.094998] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"753a5d2bcd74dc1d532cbbda","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-753a5d2bcd74dc1d532cbbda: done: 0.031039 sec","job_status":"done","queue_duration_s":4.09176,"scheduling_latency_s":4.091815,"redis_calls":13,"redis_duration_s":0.002467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031039,"completed_at":"2026-10-02T16:55:13.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 167.133721] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8acde8b80916271111aa59b","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8acde8b80916271111aa59b: start","job_status":"start","queue_duration_s":4.160628,"scheduling_latency_s":4.16067}1469gitlab # [ 167.155838] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8acde8b80916271111aa59b","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8acde8b80916271111aa59b: done: 0.02317 sec","job_status":"done","queue_duration_s":4.160628,"scheduling_latency_s":4.16067,"redis_calls":13,"redis_duration_s":0.003738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001292,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002446,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02317,"completed_at":"2026-10-02T16:55:13.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 167.195721] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"617a324fcb2ce3be39267acf","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-617a324fcb2ce3be39267acf: start","job_status":"start","queue_duration_s":4.223113,"scheduling_latency_s":4.223166}1471gitlab # [ 167.220418] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"617a324fcb2ce3be39267acf","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-617a324fcb2ce3be39267acf: done: 0.025275 sec","job_status":"done","queue_duration_s":4.223113,"scheduling_latency_s":4.223166,"redis_calls":13,"redis_duration_s":0.003764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001245,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002519,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025275,"completed_at":"2026-10-02T16:55:13.318Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 167.242850] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"627779662ced57a3a4e291d8","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-627779662ced57a3a4e291d8: start","job_status":"start","queue_duration_s":4.250352,"scheduling_latency_s":4.250383}1473gitlab # [ 167.361068] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"627779662ced57a3a4e291d8","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-627779662ced57a3a4e291d8: done: 0.138639 sec","job_status":"done","queue_duration_s":4.250352,"scheduling_latency_s":4.250383,"redis_calls":13,"redis_duration_s":0.11781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.116437,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.138639,"completed_at":"2026-10-02T16:55:13.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 167.427880] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ced1e813193f91e7ff8e416","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ced1e813193f91e7ff8e416: start","job_status":"start","queue_duration_s":4.455731,"scheduling_latency_s":4.455783}1475gitlab # [ 167.455944] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ced1e813193f91e7ff8e416","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ced1e813193f91e7ff8e416: done: 0.028101 sec","job_status":"done","queue_duration_s":4.455731,"scheduling_latency_s":4.455783,"redis_calls":13,"redis_duration_s":0.00417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001654,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002516,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028101,"completed_at":"2026-10-02T16:55:13.553Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 167.459447] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"157176cd286b5a813b21fdf2","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-157176cd286b5a813b21fdf2: start","job_status":"start","queue_duration_s":4.487435,"scheduling_latency_s":4.487473}1477gitlab # [ 167.483354] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"157176cd286b5a813b21fdf2","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-157176cd286b5a813b21fdf2: done: 0.023751 sec","job_status":"done","queue_duration_s":4.487435,"scheduling_latency_s":4.487473,"redis_calls":13,"redis_duration_s":0.003816,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001261,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002555,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023751,"completed_at":"2026-10-02T16:55:13.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 167.500111] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b493706e67a524749da1a681","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b493706e67a524749da1a681: start","job_status":"start","queue_duration_s":4.518012,"scheduling_latency_s":4.518043}1479gitlab # [ 167.515449] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b493706e67a524749da1a681","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b493706e67a524749da1a681: done: 0.025343 sec","job_status":"done","queue_duration_s":4.518012,"scheduling_latency_s":4.518043,"redis_calls":13,"redis_duration_s":0.0075970000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005486,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025343,"completed_at":"2026-10-02T16:55:13.613Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 167.565956] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"010b7d2953cb88618a97c723","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-010b7d2953cb88618a97c723: start","job_status":"start","queue_duration_s":4.545912,"scheduling_latency_s":4.545938}1481gitlab # [ 167.567054] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"010b7d2953cb88618a97c723","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-010b7d2953cb88618a97c723: done: 0.018559 sec","job_status":"done","queue_duration_s":4.545912,"scheduling_latency_s":4.545938,"redis_calls":13,"redis_duration_s":0.004108,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018559,"completed_at":"2026-10-02T16:55:13.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 167.610372] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45173ba327928efa651a69ab","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45173ba327928efa651a69ab: start","job_status":"start","queue_duration_s":4.5658,"scheduling_latency_s":4.565816}1483gitlab # [ 167.611318] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:13.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45173ba327928efa651a69ab","created_at":"2026-10-02T16:55:09.007Z","trace_propagation_headers":{"sentry-trace":"ad8ed7c850d247ab95654cc42ad69cb5-76c4f5eec2f14175","baggage":"sentry-trace_id=ad8ed7c850d247ab95654cc42ad69cb5,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7a24726ac22f3c3f334770c1a0760f4c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:09.069Z","job_size_bytes":2,"pid":1629,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45173ba327928efa651a69ab: done: 0.010906 sec","job_status":"done","queue_duration_s":4.5658,"scheduling_latency_s":4.565816,"redis_calls":13,"redis_duration_s":0.002631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010906,"completed_at":"2026-10-02T16:55:13.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 185.888434] postgres[2438]: [2438] ERROR: relation "table_without_models" does not exist1485gitlab # [ 185.889407] postgres[2438]: [2438] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1486gitlab # [ 189.333989] runuser[2226]: pam_unix(runuser:session): session closed for user gitlab1487gitlab # [ 189.335824] setup-gitlab-start[2200]: + systemctl restart gitlab-sidekiq.service1488gitlab # [ 189.362664] systemd[1]: Stopping gitlab-sidekiq.service...1489gitlab # [ 189.363898] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:35.460Z","message":"Shutting down"}1490gitlab # [ 189.365296] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:35.461Z","message":"Scheduler exiting..."}1491gitlab # [ 189.366777] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:35.462Z","message":"Terminating quiet threads for default capsule"}1492gitlab # [ 189.368429] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:35.462Z","message":"Scheduler exiting..."}1493gitlab # [ 189.866450] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:35.964Z","message":"Pausing to allow jobs to finish..."}1494gitlab # [ 192.871855] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:38.969Z","message":"Bye!"}1495gitlab # [ 192.903934] sidekiq-cluster[1629]: {"severity":"INFO","time":"2026-10-02T16:55:39.002Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1629,"worker_id":"sidekiq_0","memwd_rss_bytes":932904960,"retry":0}1496gitlab # [ 193.523488] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1497gitlab # [ 193.524322] systemd[1]: Stopped gitlab-sidekiq.service.1498gitlab # [ 193.526458] systemd[1]: gitlab-sidekiq.service: Consumed 59.200s CPU time over 1min 58.287s wall clock time, 937.6M memory peak, 4.4M read from disk.1499gitlab # [ 193.531173] systemd[1]: Started gitlab-sidekiq.service.1500gitlab # [ 193.533813] setup-gitlab-start[2200]: + mkdir -p /var/lib/secrets1501gitlab # [ 193.537504] setup-gitlab-start[2200]: + echo nixbot-test-token-of-20-chars1502gitlab # [ 193.538641] setup-gitlab-start[2200]: + chmod 644 /var/lib/secrets/gitlab-token1503gitlab # [ 193.545185] setup-gitlab-start[2200]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1504gitlab # [ 194.132881] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:40 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 5321505gitlab # [ 194.733363] gitaly[901]: time="2026-10-02T16:55:40.831Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:50.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:40.831" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1506gitlab # [ 194.742746] gitaly[901]: time="2026-10-02T16:55:40.831Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:50.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:40.831" grpc.time_ms=0.284 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1507gitlab # [ 194.858401] gitaly[901]: time="2026-10-02T16:55:40.956Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:50.135" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:40.956" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1508gitlab # [ 194.868551] gitaly[901]: time="2026-10-02T16:55:40.956Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:50.135" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:40.956" grpc.time_ms=0.41 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1509gitlab # [ 194.916978] gitaly[901]: time="2026-10-02T16:55:41.015Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN diskcache=452e7f9f-98c5-4b9d-8f99-8db3169fd9d0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T16:55:50.147" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:40.968" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1510gitlab # [ 194.927319] gitaly[901]: time="2026-10-02T16:55:41.015Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1576 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T16:55:50.147" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:40.968" grpc.time_ms=47.171 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1511gitlab # [ 194.940515] gitaly[901]: time="2026-10-02T16:55:41.026Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.025" pid=901 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1512gitlab # [ 194.950938] gitaly[901]: time="2026-10-02T16:55:41.026Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.025" grpc.time_ms=0.42 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1513gitlab # [ 194.961516] gitaly[901]: time="2026-10-02T16:55:41.042Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:55:51.012" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.032" grpc.time_ms=10.147 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1514gitlab # [ 194.994705] gitaly[901]: time="2026-10-02T16:55:41.092Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.071" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.092" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1515gitlab # [ 194.995105] gitaly[901]: time="2026-10-02T16:55:41.093Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.071" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.092" grpc.time_ms=0.408 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1516gitlab # [ 195.060158] gitaly[901]: time="2026-10-02T16:55:41.158Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN diskcache=f73562a6-a266-47ca-bc86-6984590d1be3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T16:55:51.092" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.113" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1517gitlab # [ 195.069914] gitaly[901]: time="2026-10-02T16:55:41.168Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1579 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-02T16:55:51.092" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.113" grpc.time_ms=45.545 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1518gitlab # [ 195.076909] gitaly[901]: time="2026-10-02T16:55:41.175Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.153" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.174" pid=901 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1519gitlab # [ 195.077633] gitaly[901]: time="2026-10-02T16:55:41.175Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.153" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.174" grpc.time_ms=0.761 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1520gitlab # [ 195.116931] gitaly[901]: time="2026-10-02T16:55:41.214Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:55:51.183" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.203" grpc.time_ms=11.045 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1521gitlab # [ 195.153322] gitaly[901]: time="2026-10-02T16:55:41.251Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:55:51.230" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.251" grpc.time_ms=0.239 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1522gitlab # [ 195.167647] gitaly[901]: time="2026-10-02T16:55:41.266Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T16:55:51.245" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.265" grpc.time_ms=0.19 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1523gitlab # [ 195.631550] gitaly[901]: time="2026-10-02T16:55:41.729Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRNZYV1TXEJYWF8EQBKPSN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:55:51.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:41.722" grpc.time_ms=6.549 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1524gitlab # [ 195.896885] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:41 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 17421525gitlab # [ 195.899725] setup-gitlab-start[2498]: {"id":1,"message":null,"error":null}1526gitlab # [ 196.745743] sidekiq-cluster[2481]: {"severity":"INFO","time":"2026-10-02T16:55:42.825Z","message":"Starting cluster with 1 processes"}1527gitlab # [ 201.030384] gitaly[901]: time="2026-10-02T16:55:47.127Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP6JMAP0SBYP29T0Y8DQY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:55:57.096" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:47.117" grpc.time_ms=10.056 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1528gitlab # [ 201.071300] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:47 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 1391529gitlab # [ 201.079386] setup-gitlab-start[2200]: + mkdir -p /tmp/test-flake1530gitlab # [ 201.081551] setup-gitlab-start[2200]: + cd /tmp/test-flake1531gitlab # [ 201.081692] setup-gitlab-start[2200]: + git init -b master1532gitlab # [ 201.104153] setup-gitlab-start[2572]: Initialized empty Git repository in /tmp/test-flake/.git/1533gitlab # [ 201.104946] setup-gitlab-start[2200]: + git config user.name test1534gitlab # [ 201.110983] setup-gitlab-start[2200]: + git config user.email test@example.com1535gitlab # [ 201.115062] setup-gitlab-start[2200]: + cat1536gitlab # [ 201.120396] setup-gitlab-start[2200]: + git add flake.nix1537gitlab # [ 201.127752] setup-gitlab-start[2200]: + git commit -m 'initial commit'1538gitlab # [ 201.154726] setup-gitlab-start[2577]: [master (root-commit) e152d76] initial commit1539gitlab # [ 201.154900] setup-gitlab-start[2577]: 1 file changed, 10 insertions(+)1540gitlab # [ 201.155645] setup-gitlab-start[2577]: create mode 100644 flake.nix1541gitlab # [ 201.157209] setup-gitlab-start[2200]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1542gitlab # [ 201.164778] setup-gitlab-start[2200]: + git push -u origin master1543gitlab # [ 201.228681] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 311544gitlab # [ 201.328955] gitaly[901]: time="2026-10-02T16:55:47.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP6W5HTHWB24ZGTMR853R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:47.413" grpc.time_ms=13.679 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1545gitlab # [ 201.359157] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:47 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 951546gitlab # [ 201.562742] gitaly[901]: time="2026-10-02T16:55:47.660Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:55:57.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:47.649" grpc.time_ms=11.083 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 201.599591] gitaly[901]: time="2026-10-02T16:55:47.697Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-02T16:56:17.084" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-02T16:55:47.685" grpc.time_ms=11.883 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 201.626944] gitaly[901]: time="2026-10-02T16:55:47.712Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP duration_ms=111ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/allowed"1549gitlab # [ 201.636508] gitaly[901]: time="2026-10-02T16:55:47.734Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP duration_ms=22ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/pre_receive"1550gitlab # [ 201.639566] gitaly[901]: time="2026-10-02T16:55:47.735Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:47.599" grpc.time_ms=135.946 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1551gitlab # [ 201.681629] gitaly[901]: time="2026-10-02T16:55:47.779Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:47.777" grpc.time_ms=1.661 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1552gitlab # [ 201.722907] gitaly[901]: time="2026-10-02T16:55:47.821Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:47.820" grpc.time_ms=0.503 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1553gitlab # [ 201.755415] gitaly[901]: time="2026-10-02T16:55:47.853Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:47.852" grpc.time_ms=1.521 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1554gitlab # [ 201.832522] gitaly[901]: time="2026-10-02T16:55:47.930Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:55:57.102" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:47.923" grpc.time_ms=7.195 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 201.861839] gitaly[901]: time="2026-10-02T16:55:47.960Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1569 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=11 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-02T16:55:57.116" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:55:47.936" grpc.time_ms=22.974 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1556gitlab # [ 201.883157] gitaly[901]: time="2026-10-02T16:55:47.981Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP duration_ms=96ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/post_receive"1557gitlab # [ 201.886691] gitaly[901]: time="2026-10-02T16:55:47.985Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:47.883" grpc.time_ms=101.24 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1558gitlab # [ 201.904915] gitaly[901]: time="2026-10-02T16:55:48.003Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP diskcache=3ec10615-7e1d-46cd-b319-212a104d3253 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:47.520" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1559gitlab # [ 201.914587] gitaly[901]: time="2026-10-02T16:55:48.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=209 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=876544 command.minflt=13436 command.oublock=32 command.real_time_ms=473 command.spawn_token_fork_ms=0 command.system_time_ms=132 command.user_time_ms=77 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:47.520" grpc.time_ms=482.711 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1560gitlab # [ 201.915204] setup-gitlab-start[2581]: To http://gitlab/root/test-flake.git1561gitlab # [ 201.915906] setup-gitlab-start[2581]: * [new branch] master -> master1562gitlab # [ 201.916585] gitlab-workhorse[822]: time="2026-10-02T16:55:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521563gitlab # [ 201.917419] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:48 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5371564gitlab # [ 201.932137] setup-gitlab-start[2581]: branch 'master' set up to track 'origin/master'.1565gitlab # [ 201.934178] systemd[1]: Finished setup-gitlab.service.1566gitlab # [ 201.937842] systemd[1]: Starting nixbot CI service...1567gitlab: (finished: waiting for unit setup-gitlab.service, in 203.60 seconds)1568gitlab: waiting for unit nixbot.service1569gitlab # [ 203.228946] nixbot[2659]: {"ts": "2026-10-02T16:55:49.326Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1570gitlab # [ 203.267759] nixbot[2659]: {"ts": "2026-10-02T16:55:49.365Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1571gitlab # [ 203.294143] nixbot[2659]: {"ts": "2026-10-02T16:55:49.392Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1572gitlab # [ 203.299391] nixbot[2659]: {"ts": "2026-10-02T16:55:49.397Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1573gitlab # [ 203.304580] nixbot[2659]: {"ts": "2026-10-02T16:55:49.402Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1574gitlab # [ 203.311733] nixbot[2659]: {"ts": "2026-10-02T16:55:49.409Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1575gitlab # [ 203.317120] nixbot[2659]: {"ts": "2026-10-02T16:55:49.414Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1576gitlab # [ 203.324082] nixbot[2659]: {"ts": "2026-10-02T16:55:49.422Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1577gitlab # [ 203.340423] nixbot[2659]: {"ts": "2026-10-02T16:55:49.438Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1578gitlab # [ 203.345868] nixbot[2659]: {"ts": "2026-10-02T16:55:49.443Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1579gitlab # [ 203.358335] nixbot[2659]: {"ts": "2026-10-02T16:55:49.456Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1580gitlab # [ 203.368176] nixbot[2659]: {"ts": "2026-10-02T16:55:49.466Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1581gitlab # [ 203.378408] nixbot[2659]: {"ts": "2026-10-02T16:55:49.476Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1582gitlab # [ 203.382229] nixbot[2659]: {"ts": "2026-10-02T16:55:49.480Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1583gitlab # [ 203.394695] nixbot[2659]: {"ts": "2026-10-02T16:55:49.492Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1584gitlab # [ 203.402734] nixbot[2659]: {"ts": "2026-10-02T16:55:49.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1585gitlab # [ 203.410372] nixbot[2659]: {"ts": "2026-10-02T16:55:49.508Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1586gitlab # [ 203.416388] nixbot[2659]: {"ts": "2026-10-02T16:55:49.514Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1587gitlab # [ 203.425400] nixbot[2659]: {"ts": "2026-10-02T16:55:49.523Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1588gitlab # [ 203.432838] nixbot[2659]: {"ts": "2026-10-02T16:55:49.530Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1589gitlab # [ 203.436755] nixbot[2659]: {"ts": "2026-10-02T16:55:49.534Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1590gitlab # [ 203.448433] nixbot[2659]: {"ts": "2026-10-02T16:55:49.546Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1591gitlab # [ 203.454960] nixbot[2659]: {"ts": "2026-10-02T16:55:49.553Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1592gitlab # [ 203.459586] nixbot[2659]: {"ts": "2026-10-02T16:55:49.557Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1593gitlab # [ 203.462803] nixbot[2659]: {"ts": "2026-10-02T16:55:49.561Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1594gitlab # [ 203.467187] nixbot[2659]: {"ts": "2026-10-02T16:55:49.565Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1595gitlab # [ 203.472236] nixbot[2659]: {"ts": "2026-10-02T16:55:49.570Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1596gitlab # [ 203.476460] nixbot[2659]: {"ts": "2026-10-02T16:55:49.574Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1597gitlab # [ 203.480674] nixbot[2659]: {"ts": "2026-10-02T16:55:49.578Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1598gitlab # [ 203.499852] nixbot[2659]: {"ts": "2026-10-02T16:55:49.598Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1599gitlab # [ 203.510410] nixbot[2659]: {"ts": "2026-10-02T16:55:49.608Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1600gitlab # [ 203.518214] nixbot[2659]: {"ts": "2026-10-02T16:55:49.616Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1601gitlab # [ 203.521597] nixbot[2659]: {"ts": "2026-10-02T16:55:49.619Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1602gitlab # [ 203.533430] nixbot[2659]: {"ts": "2026-10-02T16:55:49.631Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1603gitlab # [ 203.536675] nixbot[2659]: {"ts": "2026-10-02T16:55:49.634Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1604gitlab # [ 203.545914] nixbot[2659]: {"ts": "2026-10-02T16:55:49.644Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1605gitlab # [ 203.550620] nixbot[2659]: {"ts": "2026-10-02T16:55:49.648Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1606gitlab # [ 203.557074] nixbot[2659]: {"ts": "2026-10-02T16:55:49.655Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_skip_key"}1607gitlab # [ 203.921104] nixbot[2659]: INFO: Started server process [2659]1608gitlab # [ 203.921785] nixbot[2659]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1609gitlab # [ 203.956178] nixbot[2659]: INFO: ::ffff:127.0.0.1:56330 - "GET /health HTTP/1.1" 200 OK1610gitlab # [ 203.964308] systemd[1]: Started nixbot CI service.1611gitlab # [ 203.965353] systemd[1]: Reached target Multi-User System.1612gitlab # [ 203.967482] systemd[1]: Startup finished in 1.281s (kernel) + 3.653s (initrd) + 3min 19.032s (userspace) = 3min 23.967s.1613gitlab: (finished: waiting for unit nixbot.service, in 1.05 seconds)1614gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1615gitlab # [ 204.030111] nixbot[2659]: INFO: ::ffff:127.0.0.1:38468 - "GET /health HTTP/1.1" 200 OK1616gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1617subtest: project discovered and webhook registered1618gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1619gitlab # [ 204.150212] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1931620gitlab # [ 204.151989] nixbot[2659]: {"ts": "2026-10-02T16:55:50.250Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1621gitlab # [ 204.175763] nixbot[2659]: {"ts": "2026-10-02T16:55:50.273Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1622gitlab # [ 204.219683] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1551623gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds)1624gitlab # [ 204.229739] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 441625gitlab # [ 204.234434] nixbot[2659]: {"ts": "2026-10-02T16:55:50.328Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1626gitlab # [ 204.238650] nixbot[2659]: {"ts": "2026-10-02T16:55:50.330Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1627gitlab # [ 204.435452] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 2011628gitlab # [ 204.436921] nixbot[2659]: {"ts": "2026-10-02T16:55:50.535Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1629gitlab # [ 204.687262] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2341630gitlab # [ 204.688158] nixbot[2659]: {"ts": "2026-10-02T16:55:50.785Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1631gitlab # [ 204.784838] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 841632gitlab # [ 204.790957] nixbot[2659]: {"ts": "2026-10-02T16:55:50.889Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1633gitlab # [ 204.869194] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:50 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 671634gitlab # [ 204.875444] nixbot[2659]: {"ts": "2026-10-02T16:55:50.973Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1635gitlab # [ 204.967658] gitaly[901]: time="2026-10-02T16:55:51.065Z" level=info msg="finished unary call with code OK" catfile.duration_ms=4 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=4 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAEARW0J6QJW1F6P07ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-02T16:56:21.046" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:55:51.046" grpc.time_ms=17.245 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1636gitlab # [ 205.015761] gitaly[901]: time="2026-10-02T16:55:51.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAEARW0J6QJW1F6P07ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:56:21.112" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:55:51.112" grpc.time_ms=0.843 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637gitlab # [ 205.038208] gitaly[901]: time="2026-10-02T16:55:51.127Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAEARW0J6QJW1F6P07ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-02T16:56:01.006" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:55:51.116" grpc.time_ms=9.836 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 205.094521] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2061639gitlab # [ 205.095478] nixbot[2659]: {"ts": "2026-10-02T16:55:51.193Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1640gitlab # [ 205.193709] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 861641gitlab # [ 205.199798] nixbot[2659]: {"ts": "2026-10-02T16:55:51.297Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1642gitlab # [ 205.210378] nixbot[2659]: {"ts": "2026-10-02T16:55:51.308Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1643gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1644gitlab # [ 205.308610] gitaly[901]: time="2026-10-02T16:55:51.406Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPASYF3P5EG859QNM9TP9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.397" grpc.time_ms=9.327 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1645gitlab # [ 205.311651] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511646gitlab # [ 205.345472] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 921647gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1648(finished: subtest: project discovered and webhook registered, in 1.32 seconds)1649subtest: push delivers the webhook1650gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1651gitlab # [ 205.384326] gitaly[901]: time="2026-10-02T16:55:51.482Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAVMRP7Q2JWPZM9TT3EW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.471" pid=901 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1652gitlab # [ 205.384744] gitaly[901]: time="2026-10-02T16:55:51.482Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAVMRP7Q2JWPZM9TT3EW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.471" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1653gitlab # [ 205.406192] gitaly[901]: time="2026-10-02T16:55:51.504Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=646 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAVMRP7Q2JWPZM9TT3EW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.471" grpc.time_ms=11.729 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1654gitlab # [ 205.407144] gitlab-workhorse[822]: time="2026-10-02T16:55:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131655gitlab # [ 205.408869] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 921656gitlab # [ 205.461212] gitaly[901]: time="2026-10-02T16:55:51.559Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAYN6XPH73ZRC0NJPTPN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.546" pid=901 remote_ip="2001:db8:1::1" request_sha=c100dec1b88f1f1b83e5e0a163c3c0deb8ed1ff8 response_bytes=223 span.kind=server system=grpc1657gitlab # [ 205.462118] gitaly[901]: time="2026-10-02T16:55:51.559Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAYN6XPH73ZRC0NJPTPN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.546" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1658gitlab # [ 205.462979] gitaly[901]: time="2026-10-02T16:55:51.559Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPAYN6XPH73ZRC0NJPTPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.546" grpc.time_ms=12.839 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1659gitlab # [ 205.497636] gitlab-workhorse[822]: time="2026-10-02T16:55:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231660gitlab # [ 205.498374] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 861661gitlab # [ 205.597172] gitaly[901]: time="2026-10-02T16:55:51.695Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPB2RK1S6ADX6RC84W0E0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.685" grpc.time_ms=9.41 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1662gitlab # [ 205.622811] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 801663gitlab # [ 205.713909] gitaly[901]: time="2026-10-02T16:55:51.812Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPB5E06B1H959ZNYQ9RH2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.801" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1664gitlab # [ 205.714265] gitaly[901]: time="2026-10-02T16:55:51.812Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPB5E06B1H959ZNYQ9RH2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.801" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1665gitlab # [ 205.714968] gitaly[901]: time="2026-10-02T16:55:51.812Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPB5E06B1H959ZNYQ9RH2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.801" grpc.time_ms=11.423 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1666gitlab # [ 205.716898] gitlab-workhorse[822]: time="2026-10-02T16:55:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671667gitlab # [ 205.717637] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 871668gitlab # [ 205.893520] gitaly[901]: time="2026-10-02T16:55:51.991Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBBFM4R0DP83KY53BPK5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:51.979" grpc.time_ms=11.971 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1669gitlab # [ 205.922266] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1001670gitlab # [ 206.000810] gitaly[901]: time="2026-10-02T16:55:52.098Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBETM1VY20FTWK4SG8J7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:52.080" pid=901 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1671gitlab # [ 206.001126] gitaly[901]: time="2026-10-02T16:55:52.098Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBETM1VY20FTWK4SG8J7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:52.080" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1672gitlab # [ 206.002195] gitaly[901]: time="2026-10-02T16:55:52.099Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBETM1VY20FTWK4SG8J7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:55:52.080" grpc.time_ms=18.386 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1673gitlab # [ 206.002920] gitlab-workhorse[822]: time="2026-10-02T16:55:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091674gitlab # [ 206.004181] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 731675gitlab # [ 206.137677] gitaly[901]: time="2026-10-02T16:55:52.235Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:56:22.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:55:52.235" grpc.time_ms=0.669 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 206.175640] gitaly[901]: time="2026-10-02T16:55:52.273Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-02T16:56:22.064" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:55:52.264" grpc.time_ms=8.988 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1677gitlab # [ 206.190479] gitaly[901]: time="2026-10-02T16:55:52.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:02.262" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:55:52.282" grpc.time_ms=5.725 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678gitlab # [ 206.211402] gitaly[901]: time="2026-10-02T16:55:52.309Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:02.273" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:55:52.293" grpc.time_ms=15.79 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 206.253058] gitaly[901]: time="2026-10-02T16:55:52.351Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T16:56:02.000" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:52.351" grpc.time_ms=0.187 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 206.263878] gitaly[901]: time="2026-10-02T16:55:52.361Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T16:56:02.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:55:52.356" grpc.time_ms=5.296 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 206.294435] gitaly[901]: time="2026-10-02T16:55:52.392Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:52.392" grpc.time_ms=0.694 pid=901 span.kind=server system=grpc1682gitlab # [ 206.323469] gitaly[901]: time="2026-10-02T16:55:52.421Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:55:52.421" grpc.time_ms=0.491 pid=901 span.kind=server system=grpc1683gitlab # [ 206.342562] gitaly[901]: time="2026-10-02T16:55:52.440Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 diskcache=d4ab4d56-6659-437e-833a-ccb250211627 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T16:56:02.012" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:52.363" pid=901 ref=refs/keep-around/e152d76780f7c24d070a93cd291b650a5bec765b remote_ip="2001:db8:1::1" revision=e152d76780f7c24d070a93cd291b650a5bec765b span.kind=server system=grpc username=root1684gitlab # [ 206.342923] gitaly[901]: time="2026-10-02T16:55:52.441Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=49 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5306 command.oublock=8 command.real_time_ms=69 command.spawn_token_fork_ms=0 command.system_time_ms=26 command.user_time_ms=23 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T16:56:02.012" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:55:52.363" grpc.time_ms=77.662 pid=901 ref=refs/keep-around/e152d76780f7c24d070a93cd291b650a5bec765b remote_ip="2001:db8:1::1" revision=e152d76780f7c24d070a93cd291b650a5bec765b span.kind=server system=grpc username=root1685gitlab # [ 206.366981] gitaly[901]: time="2026-10-02T16:55:52.465Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:56:22.264" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:55:52.464" grpc.time_ms=0.425 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686gitlab # [ 206.491779] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:55:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 3941687gitlab # [ 206.498659] nixbot[2659]: {"ts": "2026-10-02T16:55:52.596Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1688gitlab # [ 206.517296] nixbot[2659]: {"ts": "2026-10-02T16:55:52.615Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e152d76780f7-0"}1689gitlab # [ 206.716076] nixbot[2659]: {"ts": "2026-10-02T16:55:52.814Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e152d76780f7-0", "argv0": "bwrap"}1690gitlab # [ 206.800384] systemd[1]: Started Nix Daemon.1691gitlab # [ 206.876373] nix-daemon[2827]: accepted connection from pid 2822, user nixbot1692gitlab # [ 211.307483] nix-daemon[2827]: accepted connection from pid 2870, user nixbot1693gitlab # [ 211.322403] nix-daemon[2827]: accepted connection from pid 2822, user nixbot1694gitlab # [ 216.022084] nix-daemon[2827]: accepted connection from pid 2822, user nixbot1695gitlab # [ 216.121374] nix-daemon[2827]: accepted connection from pid 2919, user nixbot1696gitlab # [ 216.177764] gitaly[901]: time="2026-10-02T16:56:02.275Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPNCTK5R7QQ0754C4NRNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:56:32.273" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:02.274" grpc.time_ms=0.825 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 216.309060] gitaly[901]: time="2026-10-02T16:56:02.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPNCTK5R7QQ0754C4NRNX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:12.285" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:02.396" grpc.time_ms=10.949 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698gitlab # [ 216.458641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 3531699gitlab # [ 216.459560] nixbot[2659]: {"ts": "2026-10-02T16:56:02.557Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1700gitlab # [ 216.517558] gitaly[901]: time="2026-10-02T16:56:02.615Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPNR0RV811PMD8TF05T94 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:56:32.613" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:02.614" grpc.time_ms=0.759 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 216.546557] gitaly[901]: time="2026-10-02T16:56:02.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPNR0RV811PMD8TF05T94 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:12.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:02.637" grpc.time_ms=6.604 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 216.579424] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1171703gitlab # [ 216.584400] nixbot[2659]: {"ts": "2026-10-02T16:56:02.678Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1704gitlab # [ 220.908541] nix-daemon[2827]: accepted connection from pid 2983, user nixbot1705gitlab # [ 220.988366] gitaly[901]: time="2026-10-02T16:56:07.086Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPT3VSWFJ3B6B02ABYRNZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:56:37.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:07.085" grpc.time_ms=0.914 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 221.024043] gitaly[901]: time="2026-10-02T16:56:07.122Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPT3VSWFJ3B6B02ABYRNZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:17.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:07.116" grpc.time_ms=5.733 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 221.075184] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1371708gitlab # [ 221.082066] nixbot[2659]: {"ts": "2026-10-02T16:56:07.179Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1709gitlab # [ 221.348560] gitaly[901]: time="2026-10-02T16:56:07.446Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPTERQ8KXTH2ZZJ83QRRQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.440" grpc.time_ms=5.823 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1710gitlab # [ 221.361651] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 751711gitlab # [ 221.417378] gitaly[901]: time="2026-10-02T16:56:07.515Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPTH7RBZ3NEBETKDVCTEW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.507" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1712gitlab # [ 221.417637] gitaly[901]: time="2026-10-02T16:56:07.515Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPTH7RBZ3NEBETKDVCTEW grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.507" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1713gitlab # [ 221.448026] gitaly[901]: time="2026-10-02T16:56:07.546Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPTH7RBZ3NEBETKDVCTEW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.507" grpc.time_ms=38.451 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1714gitlab # [ 221.448809] gitlab-workhorse[822]: time="2026-10-02T16:56:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671715gitlab # [ 221.449271] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 831716gitlab # [ 221.525282] gitaly[901]: time="2026-10-02T16:56:07.623Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPTMYZHYRH6ZWXAZKB80B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=200 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.613" grpc.time_ms=9.399 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1717gitlab # [ 221.537595] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 531718gitlab # [ 221.585739] gitaly[901]: time="2026-10-02T16:56:07.684Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPTPQFEFB9RSKBC56D8F9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.676" pid=901 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1719gitlab # [ 221.586001] gitaly[901]: time="2026-10-02T16:56:07.684Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPTPQFEFB9RSKBC56D8F9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.676" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1720gitlab # [ 221.586733] gitaly[901]: time="2026-10-02T16:56:07.684Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPTPQFEFB9RSKBC56D8F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:07.676" grpc.time_ms=8.07 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1721gitlab # [ 221.587454] gitlab-workhorse[822]: time="2026-10-02T16:56:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671722gitlab # [ 221.588871] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 451723gitlab # [ 222.551975] sidekiq-cluster[2545]: 2026-10-02T16:56:08.649Z pid=2545 tid=xuh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2545, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>443367424}1724gitlab # [ 222.726688] sidekiq-cluster[2545]: W, [2026-10-02T16:56:08.824997 #2545] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1725gitlab # [ 222.767278] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:08.865Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1726gitlab # [ 224.510843] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:10.608Z","message":"GitLab reliable fetch activated!"}1727gitlab # [ 224.511429] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:10.608Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1728gitlab # [ 244.189178] postgres[3227]: [3227] ERROR: relation "table_without_models" does not exist1729gitlab # [ 244.190183] postgres[3227]: [3227] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1730gitlab # [ 246.636405] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:32.734Z","message":"Booted Rails 7.2.3.1 application in production environment"}1731gitlab # [ 246.637346] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:32.735Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1732gitlab # [ 246.639335] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:32.737Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1733gitlab # [ 246.640430] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:32.737Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1734gitlab # [ 246.642066] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:32.739Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1735gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 41.53 seconds)1736gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1737gitlab # [ 246.993814] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:33 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 531738gitlab # [ 247.101085] gitaly[901]: time="2026-10-02T16:56:33.198Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKJ984KCRT6R2J149KRD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:33.185" grpc.time_ms=12.418 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739gitlab # [ 247.131702] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:33 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1321740gitlab # Enumerating objects: 5, done.1741gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1742gitlab # Delta compression using up to 4 threads1743gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1744gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1745gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1746gitlab # [ 247.402419] gitaly[901]: time="2026-10-02T16:56:33.500Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=328 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-02T16:57:03.487" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-02T16:56:33.487" grpc.time_ms=12.443 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747gitlab # [ 247.449893] gitaly[901]: time="2026-10-02T16:56:33.548Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ duration_ms=129ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/allowed"1748gitlab # [ 247.479208] gitaly[901]: time="2026-10-02T16:56:33.577Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ duration_ms=25ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/pre_receive"1749gitlab # [ 247.485194] gitaly[901]: time="2026-10-02T16:56:33.578Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:33.418" grpc.time_ms=159.776 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1750gitlab # [ 247.546479] gitaly[901]: time="2026-10-02T16:56:33.644Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:33.644" grpc.time_ms=0.479 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1751gitlab # [ 247.598970] gitaly[901]: time="2026-10-02T16:56:33.697Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:33.696" grpc.time_ms=0.829 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1752gitlab # [ 247.634712] gitaly[901]: time="2026-10-02T16:56:33.733Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:33.732" grpc.time_ms=0.4 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1753gitlab # [ 247.699189] gitaly[901]: time="2026-10-02T16:56:33.797Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ duration_ms=32ns method=POST pid=901 status=200 url="http://unix/api/v4/internal/post_receive"1754gitlab # [ 247.699865] gitaly[901]: time="2026-10-02T16:56:33.798Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:33.764" grpc.time_ms=34.063 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1755gitlab # [ 247.726995] gitaly[901]: time="2026-10-02T16:56:33.825Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ diskcache=ea8bf190-0d5c-4412-93b5-e9ec50e893c3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:33.335" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1756gitlab # [ 247.736415] gitaly[901]: time="2026-10-02T16:56:33.834Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=249 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=868352 command.minflt=13511 command.oublock=32 command.real_time_ms=479 command.spawn_token_fork_ms=1 command.system_time_ms=163 command.user_time_ms=86 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:33.335" grpc.time_ms=490.274 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1757gitlab # [ 247.736823] gitlab-workhorse[822]: time="2026-10-02T16:56:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521758gitlab # [ 247.737478] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:33 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5801759gitlab # To http://gitlab/root/test-flake.git1760gitlab # e152d76..5264138 master -> master1761gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.88 seconds)1762gitlab: must succeed: git -C /tmp/test-flake rev-parse master1763gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1764gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1765gitlab # [ 247.843948] nixbot[2659]: INFO: ::ffff:127.0.0.1:34796 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1766gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.07 seconds)1767gitlab # [ 248.544149] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:34.641Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c12b7608673ce3fbcb1e532a","created_at":"2026-10-02T16:55:41.052Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.076Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c12b7608673ce3fbcb1e532a: start","job_status":"start","queue_duration_s":53.564627,"scheduling_latency_s":53.564713}1768gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1769gitlab # [ 248.781166] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:34.878Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"c12b7608673ce3fbcb1e532a","created_at":"2026-10-02T16:55:41.052Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.076Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-c12b7608673ce3fbcb1e532a: done: 0.238215 sec","job_status":"done","queue_duration_s":53.564627,"scheduling_latency_s":53.564713,"redis_calls":24,"redis_duration_s":0.007888,"redis_read_bytes":1038,"redis_write_bytes":2604,"redis_feature_flag_calls":14,"redis_feature_flag_duration_s":0.004627,"redis_feature_flag_read_bytes":1030,"redis_feature_flag_write_bytes":1439,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001747,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1000792,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.238215,"completed_at":"2026-10-02T16:56:34.878Z","load_balancing_strategy":"primary","db_duration_s":0.062105,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1770gitlab # [ 248.782756] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:34.880Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"2a348b6189ad7a7d5b92a342","created_at":"2026-10-02T16:55:41.084Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.088Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-2a348b6189ad7a7d5b92a342: start","job_status":"start","queue_duration_s":53.791933,"scheduling_latency_s":53.79195}1771gitlab # [ 248.871267] nixbot[2659]: INFO: ::ffff:127.0.0.1:34808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1772gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.03 seconds)1773gitlab # [ 248.891223] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:34.989Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"2a348b6189ad7a7d5b92a342","created_at":"2026-10-02T16:55:41.084Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.088Z","job_size_bytes":2,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-2a348b6189ad7a7d5b92a342: done: 0.108748 sec","job_status":"done","queue_duration_s":53.791933,"scheduling_latency_s":53.79195,"redis_calls":14,"redis_duration_s":0.003122,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.089309955,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.108748,"completed_at":"2026-10-02T16:56:34.989Z","load_balancing_strategy":"primary","db_duration_s":0.025635,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1774gitlab # [ 248.892894] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:34.990Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"26a086dabb2d2acff0ab27e2","created_at":"2026-10-02T16:55:41.642Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.647Z","job_size_bytes":5,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-26a086dabb2d2acff0ab27e2: start","job_status":"start","queue_duration_s":53.343415,"scheduling_latency_s":53.343432}1775gitlab # [ 249.024284] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.122Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"26a086dabb2d2acff0ab27e2","created_at":"2026-10-02T16:55:41.642Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.647Z","job_size_bytes":5,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-26a086dabb2d2acff0ab27e2: done: 0.131514 sec","job_status":"done","queue_duration_s":53.343415,"scheduling_latency_s":53.343432,"redis_calls":12,"redis_duration_s":0.002713,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000642,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001609,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302832,"duration_s":0.131514,"completed_at":"2026-10-02T16:56:35.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027325,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1776gitlab # [ 249.090541] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.123Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9ebc8c6d92270ef782d9775f","created_at":"2026-10-02T16:55:41.669Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.673Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9ebc8c6d92270ef782d9775f: start","job_status":"start","queue_duration_s":53.450409,"scheduling_latency_s":53.450423}1777gitlab # [ 249.204364] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.302Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9ebc8c6d92270ef782d9775f","created_at":"2026-10-02T16:55:41.669Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.673Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9ebc8c6d92270ef782d9775f: done: 0.178744 sec","job_status":"done","queue_duration_s":53.450409,"scheduling_latency_s":53.450423,"redis_calls":11,"redis_duration_s":0.003234,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.152,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.152,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000301993,"duration_s":0.178744,"completed_at":"2026-10-02T16:56:35.302Z","load_balancing_strategy":"primary","db_duration_s":0.076826,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1778gitlab # [ 249.205645] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.303Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"942cdc7f757ec859e55f1606","created_at":"2026-10-02T16:55:41.675Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.678Z","job_size_bytes":89,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-942cdc7f757ec859e55f1606: start","job_status":"start","queue_duration_s":53.625258,"scheduling_latency_s":53.625274}1779gitlab # [ 249.276740] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.330Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"942cdc7f757ec859e55f1606","created_at":"2026-10-02T16:55:41.675Z","trace_propagation_headers":{"sentry-trace":"e41efddd968c47abab26af8fb7809ca8-be878f793d4f4969","baggage":"sentry-trace_id=e41efddd968c47abab26af8fb7809ca8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRNZYV1TXEJYWF8EQBKPSN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:41.678Z","job_size_bytes":89,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-942cdc7f757ec859e55f1606: done: 0.026382 sec","job_status":"done","queue_duration_s":53.625258,"scheduling_latency_s":53.625274,"redis_calls":11,"redis_duration_s":0.002561,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000672,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001422,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000293893,"duration_s":0.026382,"completed_at":"2026-10-02T16:56:35.330Z","load_balancing_strategy":"primary","db_duration_s":0.005431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1780gitlab # [ 249.293093] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.331Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e152d76780f7c24d070a93cd291b650a5bec765b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3cda2bbbadcc52b2ecdc7cbc","created_at":"2026-10-02T16:55:47.908Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-f5cbd9bb7b054d03","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:47.912Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3cda2bbbadcc52b2ecdc7cbc: start","job_status":"start","queue_duration_s":47.419258,"scheduling_latency_s":47.419272}1781gitlab # [ 249.341177] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:35.342Z","message":"changes: \"0000000000000000000000000000000000000000 e152d76780f7c24d070a93cd291b650a5bec765b refs/heads/master\\n\""}1782gitlab # [ 249.342646] gitaly[901]: time="2026-10-02T16:56:35.374Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:45.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:35.364" grpc.time_ms=10.632 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 249.343387] gitaly[901]: time="2026-10-02T16:56:35.389Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:56:45.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:35.383" grpc.time_ms=5.78 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 249.354849] gitaly[901]: time="2026-10-02T16:56:35.453Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-02T16:56:45.083" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:35.443" grpc.time_ms=9.176 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 249.397569] gitaly[901]: time="2026-10-02T16:56:35.495Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:35.495" grpc.time_ms=0.399 pid=901 span.kind=server system=grpc1786gitlab # [ 249.434106] gitaly[901]: time="2026-10-02T16:56:35.532Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:35.531" grpc.time_ms=0.441 pid=901 span.kind=server system=grpc1787gitlab # [ 249.453555] gitaly[901]: time="2026-10-02T16:56:35.551Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP diskcache=2e3bbde0-a896-445d-b0ec-02ec4ecd27e9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T16:56:45.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:35.462" pid=901 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1788gitlab # [ 249.453796] gitaly[901]: time="2026-10-02T16:56:35.552Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=54 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4753 command.oublock=8 command.real_time_ms=81 command.spawn_token_fork_ms=0 command.system_time_ms=39 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T16:56:45.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:35.462" grpc.time_ms=89.28 pid=901 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1789gitlab # [ 249.489934] gitaly[901]: time="2026-10-02T16:56:35.588Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-02T16:56:45.227" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:35.587" grpc.time_ms=0.136 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 249.504352] gitaly[901]: time="2026-10-02T16:56:35.602Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=940 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-02T16:56:45.230" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:35.590" grpc.time_ms=11.562 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 249.591889] gitaly[901]: time="2026-10-02T16:56:35.690Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-02T16:57:05.080" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:35.681" grpc.time_ms=8.782 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 249.623988] gitaly[901]: time="2026-10-02T16:56:35.713Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T16:56:45.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:35.713" grpc.time_ms=0.379 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 249.624706] gitaly[901]: time="2026-10-02T16:56:35.720Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-02T16:56:45.004" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-02T16:56:35.715" grpc.time_ms=4.811 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1794gitlab # [ 249.641096] gitaly[901]: time="2026-10-02T16:56:35.739Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:45.020" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:35.730" grpc.time_ms=8.531 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1795gitlab # [ 249.678087] gitaly[901]: time="2026-10-02T16:56:35.776Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:45.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:35.766" grpc.time_ms=9.923 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1796gitlab # [ 249.715296] gitaly[901]: time="2026-10-02T16:56:35.813Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-02T16:57:05.195" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:35.795" grpc.time_ms=17.63 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1798gitlab # [ 249.921143] nixbot[2659]: INFO: ::ffff:127.0.0.1:34814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1799gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.05 seconds)1800gitlab # [ 250.162870] gitaly[901]: time="2026-10-02T16:56:36.261Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-02T16:56:46.008" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:36.258" grpc.time_ms=2.344 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 250.206727] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:36.303Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e152d76780f7c24d070a93cd291b650a5bec765b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"3cda2bbbadcc52b2ecdc7cbc","created_at":"2026-10-02T16:55:47.908Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-f5cbd9bb7b054d03","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:55:47.912Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-3cda2bbbadcc52b2ecdc7cbc: done: 0.972512 sec","job_status":"done","queue_duration_s":47.419258,"scheduling_latency_s":47.419272,"gitaly_calls":13,"gitaly_duration_s":0.268894,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.05724,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.004373,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.006681,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001688,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005081,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.02656,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012857,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.177,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.2,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.56911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000439441,"exclusive_lock_hold_duration_s":0.02986441,"duration_s":0.972512,"completed_at":"2026-10-02T16:56:36.303Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.095069,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1802gitlab # [ 250.221344] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:36.305Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e41b8ba9289da1e65c19d8c8","created_at":"2026-10-02T16:55:52.480Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.485Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e41b8ba9289da1e65c19d8c8: start","job_status":"start","queue_duration_s":43.819822,"scheduling_latency_s":43.819872}1803gitlab # [ 250.281081] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:36.374Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e41b8ba9289da1e65c19d8c8","created_at":"2026-10-02T16:55:52.480Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.485Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e41b8ba9289da1e65c19d8c8: done: 0.068852 sec","job_status":"done","queue_duration_s":43.819822,"scheduling_latency_s":43.819872,"redis_calls":16,"redis_duration_s":0.004097,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002119,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367365,"duration_s":0.068852,"completed_at":"2026-10-02T16:56:36.374Z","load_balancing_strategy":"primary","db_duration_s":0.02154,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1804gitlab # [ 250.293660] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:36.376Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"000a13ec75232eef2b34b499","created_at":"2026-10-02T16:55:52.486Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.489Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-000a13ec75232eef2b34b499: start","job_status":"start","queue_duration_s":43.886765,"scheduling_latency_s":43.886782}1805gitlab # [ 250.371426] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:36.469Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"000a13ec75232eef2b34b499","created_at":"2026-10-02T16:55:52.486Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.489Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-000a13ec75232eef2b34b499: done: 0.093017 sec","job_status":"done","queue_duration_s":43.886765,"scheduling_latency_s":43.886782,"redis_calls":21,"redis_duration_s":0.005299,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002294,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001434,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041821,"duration_s":0.093017,"completed_at":"2026-10-02T16:56:36.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026836,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1806gitlab # [ 250.415263] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:36.513Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"085f0fa4e5fa9e9b807b010d","created_at":"2026-10-02T16:55:52.571Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.576Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-085f0fa4e5fa9e9b807b010d: start","job_status":"start","queue_duration_s":43.936833,"scheduling_latency_s":43.936876}1807gitlab # [ 250.588166] gitaly[901]: time="2026-10-02T16:56:36.685Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:36.685" grpc.time_ms=0.409 pid=901 span.kind=server system=grpc1808gitlab # [ 250.647889] gitaly[901]: time="2026-10-02T16:56:36.746Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:36.745" grpc.time_ms=0.672 pid=901 span.kind=server system=grpc1809gitlab # [ 250.709589] gitaly[901]: time="2026-10-02T16:56:36.807Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:36.806" grpc.time_ms=1.329 pid=901 span.kind=server system=grpc1810gitlab # [ 250.741946] gitaly[901]: time="2026-10-02T16:56:36.840Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 diskcache=31ac7dad-b9fa-4703-af21-6c8b7d43d742 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:06.041" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:36.641" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 250.759382] gitaly[901]: time="2026-10-02T16:56:36.857Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=181 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7256 command.oublock=0 command.real_time_ms=186 command.spawn_token_fork_ms=0 command.system_time_ms=113 command.user_time_ms=68 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:06.041" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:36.641" grpc.time_ms=198.435 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1812gitlab # [ 250.895584] gitaly[901]: time="2026-10-02T16:56:36.993Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:06.391" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:36.992" grpc.time_ms=1.343 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1814gitlab # [ 250.967770] nixbot[2659]: INFO: ::ffff:127.0.0.1:34818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1815gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.05 seconds)1816gitlab # [ 250.978927] gitaly[901]: time="2026-10-02T16:56:37.077Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRPBM23YX4WREN4A967GX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:07.074" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.075" grpc.time_ms=1.257 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 250.996555] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.094Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"085f0fa4e5fa9e9b807b010d","created_at":"2026-10-02T16:55:52.571Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.576Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-085f0fa4e5fa9e9b807b010d: rescheduled"}1818gitlab # [ 251.010379] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.108Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"085f0fa4e5fa9e9b807b010d","created_at":"2026-10-02T16:55:52.571Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-62ffda996de84bf6","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:55:52.576Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-085f0fa4e5fa9e9b807b010d: done: 0.595183 sec","job_status":"done","queue_duration_s":43.936833,"scheduling_latency_s":43.936876,"gitaly_calls":3,"gitaly_duration_s":0.228072,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.032614,"redis_read_bytes":460,"redis_write_bytes":29294,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00126,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002069,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.011453,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.005169,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15581,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.007445,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000629,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000736,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002593,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.018,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.021,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.057,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.242822,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.5150137800000001,"duration_s":0.595183,"completed_at":"2026-10-02T16:56:37.108Z","load_balancing_strategy":"primary","db_duration_s":0.101385,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1819gitlab # [ 251.060204] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.110Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e152d76780f7c24d070a93cd291b650a5bec765b 52641386fed9b3cfc34ef03d2f5d2c1030d9b27e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"46ac97385aad2c6e8211ee6a","created_at":"2026-10-02T16:56:33.785Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-39692e6fe0714f74","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:56:33.787Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-46ac97385aad2c6e8211ee6a: start","job_status":"start","queue_duration_s":3.323031,"scheduling_latency_s":3.32306}1820gitlab # [ 251.060976] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.122Z","message":"changes: \"e152d76780f7c24d070a93cd291b650a5bec765b 52641386fed9b3cfc34ef03d2f5d2c1030d9b27e refs/heads/master\\n\""}1821gitlab # [ 251.061579] gitaly[901]: time="2026-10-02T16:56:37.148Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:47.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:37.137" grpc.time_ms=11.614 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 251.065680] gitaly[901]: time="2026-10-02T16:56:37.163Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-02T16:56:47.022" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:37.152" grpc.time_ms=10.271 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 251.078459] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.170Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"5f2996b45fd2a571f7579da4","created_at":"2026-10-02T16:56:37.167Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"27732153f51ff7c48d4d5ef6","job_size_bytes":46,"pid":2545,"job_status":"deduplicated","message":"ProjectCacheWorker JID-5f2996b45fd2a571f7579da4: deduplicated: until executing","deduplication.type":"until executing"}1824gitlab # [ 251.127751] gitaly[901]: time="2026-10-02T16:56:37.196Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-02T16:56:47.055" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:37.186" grpc.time_ms=10.06 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 251.128638] gitaly[901]: time="2026-10-02T16:56:37.213Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-02T16:57:07.200" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.201" grpc.time_ms=12.406 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 251.135940] gitaly[901]: time="2026-10-02T16:56:37.234Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-02T16:56:47.094" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-02T16:56:37.225" grpc.time_ms=9.036 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 251.152099] gitaly[901]: time="2026-10-02T16:56:37.250Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:47.112" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:37.242" grpc.time_ms=7.536 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab # [ 251.242907] gitaly[901]: time="2026-10-02T16:56:37.341Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-02T16:56:47.209" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.339" grpc.time_ms=1.086 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1829gitlab # [ 251.257198] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.354Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e152d76780f7c24d070a93cd291b650a5bec765b 52641386fed9b3cfc34ef03d2f5d2c1030d9b27e refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"46ac97385aad2c6e8211ee6a","created_at":"2026-10-02T16:56:33.785Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-39692e6fe0714f74","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-02T16:56:33.787Z","job_size_bytes":185,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-46ac97385aad2c6e8211ee6a: done: 0.244297 sec","job_status":"done","queue_duration_s":3.323031,"scheduling_latency_s":3.32306,"gitaly_calls":7,"gitaly_duration_s":0.079569,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.022769,"redis_read_bytes":501,"redis_write_bytes":11939,"redis_cache_calls":9,"redis_cache_duration_s":0.002177,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001197,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5716,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003983,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.008255,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.007157,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.026,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.026,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051906,"exclusive_lock_hold_duration_s":0.019811456,"duration_s":0.244297,"completed_at":"2026-10-02T16:56:37.354Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023741,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1830gitlab # [ 251.263418] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.356Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"27732153f51ff7c48d4d5ef6","created_at":"2026-10-02T16:56:35.393Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:35.418Z","job_size_bytes":46,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-27732153f51ff7c48d4d5ef6: start","job_status":"start","queue_duration_s":1.937934,"scheduling_latency_s":1.937953}1831gitlab # [ 251.290971] gitaly[901]: time="2026-10-02T16:56:37.389Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-02T22:56:37.386" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:37.386" grpc.time_ms=2.139 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 251.307141] gitaly[901]: time="2026-10-02T16:56:37.405Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-02T16:57:07.393" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.394" grpc.time_ms=10.949 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 251.331470] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.429Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"27732153f51ff7c48d4d5ef6","created_at":"2026-10-02T16:56:35.393Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:35.418Z","job_size_bytes":46,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-27732153f51ff7c48d4d5ef6: done: 0.073414 sec","job_status":"done","queue_duration_s":1.937934,"scheduling_latency_s":1.937953,"gitaly_calls":2,"gitaly_duration_s":0.019684,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007408,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001438,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000611,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002195,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002495,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000277689,"duration_s":0.073414,"completed_at":"2026-10-02T16:56:37.429Z","load_balancing_strategy":"primary","db_duration_s":0.012682,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1834gitlab # [ 251.375546] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.430Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f862402e3d1e6f1b9f0e6cc9","created_at":"2026-10-02T16:56:35.434Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:35.439Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f862402e3d1e6f1b9f0e6cc9: start","job_status":"start","queue_duration_s":1.991574,"scheduling_latency_s":1.991588}1835gitlab # [ 251.379335] gitaly[901]: time="2026-10-02T16:56:37.477Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP diskcache=4df9808b-dcd4-4ffa-83bf-b756dc746146 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T22:56:37.446" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.447" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 251.380188] gitaly[901]: time="2026-10-02T16:56:37.477Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T22:56:37.446" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.447" grpc.time_ms=30.078 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 251.412067] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.509Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f862402e3d1e6f1b9f0e6cc9","created_at":"2026-10-02T16:56:35.434Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:35.439Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f862402e3d1e6f1b9f0e6cc9: done: 0.079219 sec","job_status":"done","queue_duration_s":1.991574,"scheduling_latency_s":1.991588,"gitaly_calls":1,"gitaly_duration_s":0.032499,"redis_calls":15,"redis_duration_s":0.003647,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000681,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.060897963,"duration_s":0.079219,"completed_at":"2026-10-02T16:56:37.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011957,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 251.463465] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.511Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"2827f27994aaff341081fc63","created_at":"2026-10-02T16:56:35.583Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:35.585Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2827f27994aaff341081fc63: start","job_status":"start","queue_duration_s":1.925936,"scheduling_latency_s":1.925954}1839gitlab # [ 251.464719] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.544Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"2827f27994aaff341081fc63","created_at":"2026-10-02T16:56:35.583Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:35.585Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-2827f27994aaff341081fc63: done: 0.03313 sec","job_status":"done","queue_duration_s":1.925936,"scheduling_latency_s":1.925954,"gitaly_calls":1,"gitaly_duration_s":0.008418,"redis_calls":16,"redis_duration_s":0.002564,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000226,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001117,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03313,"completed_at":"2026-10-02T16:56:37.544Z","load_balancing_strategy":"primary","db_duration_s":0.001734,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1840gitlab # [ 251.524224] gitaly[901]: time="2026-10-02T16:56:37.537Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-02T16:57:07.530" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.531" grpc.time_ms=6.27 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 251.525058] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:37.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"9cdf16d7f5fcd44be35d957a","created_at":"2026-10-02T16:56:36.035Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:efcb65571f19fdb4e623c39c9506a9e5c002fe62482e4dd47cd3434f565d149c","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.046Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-9cdf16d7f5fcd44be35d957a: start","job_status":"start","queue_duration_s":1.499032,"scheduling_latency_s":1.499051}1842gitlab # [ 251.525888] gitaly[901]: time="2026-10-02T16:56:37.563Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:07.562" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.563" grpc.time_ms=0.507 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 251.530547] gitaly[901]: time="2026-10-02T16:56:37.571Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T16:56:47.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:37.565" grpc.time_ms=5.32 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 251.554797] gitaly[901]: time="2026-10-02T16:56:37.653Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:07.651" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.652" grpc.time_ms=0.801 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 251.560338] gitaly[901]: time="2026-10-02T16:56:37.658Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=122 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-02T16:57:07.655" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:37.655" grpc.time_ms=2.577 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 251.634315] gitaly[901]: time="2026-10-02T16:56:37.732Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:47.164" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:37.724" grpc.time_ms=7.254 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1848gitlab # [ 252.021710] nixbot[2659]: INFO: ::ffff:127.0.0.1:34830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.05 seconds)1850gitlab # [ 252.149661] gitaly[901]: time="2026-10-02T16:56:38.247Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=957 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-02T16:57:08.229" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:38.230" grpc.time_ms=17.686 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1851gitlab # [ 252.202731] gitaly[901]: time="2026-10-02T16:56:38.300Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRP70AAK6PPZJJCGXNN9AP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-02T16:57:08.283" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:38.283" grpc.time_ms=16.864 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 252.263715] sidekiq-cluster[2545]: {"severity":"WARN","time":"2026-10-02T16:56:38.361Z","class":"CreatePipelineWorker","correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"e152d76780f7c24d070a93cd291b650a5bec765b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e152d76780f7c24d070a93cd291b650a5bec765b","ref":"refs/heads/master"},"retry":0}1853gitlab # [ 252.273627] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.371Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"9cdf16d7f5fcd44be35d957a","created_at":"2026-10-02T16:56:36.035Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:efcb65571f19fdb4e623c39c9506a9e5c002fe62482e4dd47cd3434f565d149c","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.046Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-9cdf16d7f5fcd44be35d957a: done: 0.825633 sec","job_status":"done","queue_duration_s":1.499032,"scheduling_latency_s":1.499051,"gitaly_calls":7,"gitaly_duration_s":0.136112,"redis_calls":51,"redis_duration_s":0.009776,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000798,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.004082,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001358,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002266,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.647353,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088,"duration_s":0.825633,"completed_at":"2026-10-02T16:56:38.371Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041072,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1854gitlab # [ 252.335212] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.373Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8390e4f6-c0d6-41a4-bf03-34c6a7106fbb\"}"],"class":"WebHookWorker","jid":"4838ec6e4b71baf7e5253fad","created_at":"2026-10-02T16:56:36.231Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7e7e5469180b80550f158c169c16c45c03157752f5647374c39eb4209c6b9a56","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.238Z","job_size_bytes":1751,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4838ec6e4b71baf7e5253fad: start","job_status":"start","queue_duration_s":2.135588,"scheduling_latency_s":2.13562}1855gitlab # [ 252.428108] nixbot[2659]: INFO: ::ffff:127.0.0.1:34842 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1856gitlab # [ 252.454122] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.551Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8390e4f6-c0d6-41a4-bf03-34c6a7106fbb\"}"],"class":"WebHookWorker","jid":"4838ec6e4b71baf7e5253fad","created_at":"2026-10-02T16:56:36.231Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-5ffadd7305614c12","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7e7e5469180b80550f158c169c16c45c03157752f5647374c39eb4209c6b9a56","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.238Z","job_size_bytes":1751,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4838ec6e4b71baf7e5253fad: done: 0.178061 sec","job_status":"done","queue_duration_s":2.135588,"scheduling_latency_s":2.13562,"redis_calls":19,"redis_duration_s":0.005603,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001212,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000796,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002407,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001188,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.05747099099997399,"cpu_s":0.099878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000513194,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.178061,"completed_at":"2026-10-02T16:56:38.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1857gitlab # [ 252.519684] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.554Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e27ab646363d526f21778427","created_at":"2026-10-02T16:56:36.630Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.633Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e27ab646363d526f21778427: start","job_status":"start","queue_duration_s":1.920366,"scheduling_latency_s":1.920402}1858gitlab # [ 252.520520] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.618Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"e27ab646363d526f21778427","created_at":"2026-10-02T16:56:36.630Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.633Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-e27ab646363d526f21778427: done: 0.06415 sec","job_status":"done","queue_duration_s":1.920366,"scheduling_latency_s":1.920402,"redis_calls":10,"redis_duration_s":0.0027549999999999996,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000596,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030367,"duration_s":0.06415,"completed_at":"2026-10-02T16:56:38.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011099,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1859gitlab # [ 252.539847] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.619Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e681f0d167e4f12c4de4680e","created_at":"2026-10-02T16:56:36.864Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.869Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e681f0d167e4f12c4de4680e: start","job_status":"start","queue_duration_s":1.750233,"scheduling_latency_s":1.750248}1860gitlab # [ 252.556052] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.644Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"e681f0d167e4f12c4de4680e","created_at":"2026-10-02T16:56:36.864Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.869Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-e681f0d167e4f12c4de4680e: done: 0.024529 sec","job_status":"done","queue_duration_s":1.750233,"scheduling_latency_s":1.750248,"redis_calls":10,"redis_duration_s":0.0019039999999999999,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000431,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023299,"duration_s":0.024529,"completed_at":"2026-10-02T16:56:38.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1861gitlab # [ 252.597896] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"73dfb00a6e3bac9ba6225ea9","created_at":"2026-10-02T16:56:36.881Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.892Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-73dfb00a6e3bac9ba6225ea9: start","job_status":"start","queue_duration_s":1.753151,"scheduling_latency_s":1.753164}1862gitlab # [ 252.637237] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.676Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"73dfb00a6e3bac9ba6225ea9","created_at":"2026-10-02T16:56:36.881Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.892Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-73dfb00a6e3bac9ba6225ea9: done: 0.030745 sec","job_status":"done","queue_duration_s":1.753151,"scheduling_latency_s":1.753164,"redis_calls":10,"redis_duration_s":0.001573,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000311,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000242489,"duration_s":0.030745,"completed_at":"2026-10-02T16:56:38.675Z","load_balancing_strategy":"primary","db_duration_s":0.01244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1863gitlab # [ 252.687279] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.677Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"53d749a37f49a166e00ef030","created_at":"2026-10-02T16:56:36.914Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.921Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-53d749a37f49a166e00ef030: start","job_status":"start","queue_duration_s":1.755763,"scheduling_latency_s":1.755776}1864gitlab # [ 252.688069] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.748Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"53d749a37f49a166e00ef030","created_at":"2026-10-02T16:56:36.914Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.921Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-53d749a37f49a166e00ef030: done: 0.071622 sec","job_status":"done","queue_duration_s":1.755763,"scheduling_latency_s":1.755776,"redis_calls":13,"redis_duration_s":0.003117,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00052,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237461,"duration_s":0.071622,"completed_at":"2026-10-02T16:56:38.748Z","load_balancing_strategy":"primary","db_duration_s":0.003263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1865gitlab # [ 252.729741] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a70b50fefba56b026a302b3f","created_at":"2026-10-02T16:56:36.922Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.928Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a70b50fefba56b026a302b3f: start","job_status":"start","queue_duration_s":1.821931,"scheduling_latency_s":1.821951}1866gitlab # [ 252.730632] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a70b50fefba56b026a302b3f","created_at":"2026-10-02T16:56:36.922Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.928Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a70b50fefba56b026a302b3f: done: 0.024487 sec","job_status":"done","queue_duration_s":1.821931,"scheduling_latency_s":1.821951,"redis_calls":10,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257296,"duration_s":0.024487,"completed_at":"2026-10-02T16:56:38.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 252.771058] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.775Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"98fa8ccd0bce7243511dface","created_at":"2026-10-02T16:56:36.928Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.935Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-98fa8ccd0bce7243511dface: start","job_status":"start","queue_duration_s":1.8396,"scheduling_latency_s":1.839614}1868gitlab # [ 252.778121] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"98fa8ccd0bce7243511dface","created_at":"2026-10-02T16:56:36.928Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.935Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-98fa8ccd0bce7243511dface: done: 0.020704 sec","job_status":"done","queue_duration_s":1.8396,"scheduling_latency_s":1.839614,"redis_calls":11,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001039,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214832,"duration_s":0.020704,"completed_at":"2026-10-02T16:56:38.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1869gitlab # [ 252.831897] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.797Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8a281846f225acfc0db9927c","created_at":"2026-10-02T16:56:36.940Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.946Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8a281846f225acfc0db9927c: start","job_status":"start","queue_duration_s":1.851067,"scheduling_latency_s":1.851081}1870gitlab # [ 252.835742] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.847Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"8a281846f225acfc0db9927c","created_at":"2026-10-02T16:56:36.940Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.946Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-8a281846f225acfc0db9927c: done: 0.050025 sec","job_status":"done","queue_duration_s":1.851067,"scheduling_latency_s":1.851081,"redis_calls":10,"redis_duration_s":0.001578,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256457,"duration_s":0.050025,"completed_at":"2026-10-02T16:56:38.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1871gitlab # [ 252.877815] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"56a9832de013258db34e5a3e","created_at":"2026-10-02T16:56:36.947Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.952Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-56a9832de013258db34e5a3e: start","job_status":"start","queue_duration_s":1.895802,"scheduling_latency_s":1.895817}1872gitlab # [ 252.926736] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.874Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"56a9832de013258db34e5a3e","created_at":"2026-10-02T16:56:36.947Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.952Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-56a9832de013258db34e5a3e: done: 0.025981 sec","job_status":"done","queue_duration_s":1.895802,"scheduling_latency_s":1.895817,"redis_calls":10,"redis_duration_s":0.001772,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000372,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000266515,"duration_s":0.025981,"completed_at":"2026-10-02T16:56:38.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004545,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1873gitlab # [ 252.969532] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.875Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0f59609f3e56380013710286","created_at":"2026-10-02T16:56:36.959Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.964Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0f59609f3e56380013710286: start","job_status":"start","queue_duration_s":1.911371,"scheduling_latency_s":1.911385}1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1875gitlab # [ 252.970582] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.901Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"0f59609f3e56380013710286","created_at":"2026-10-02T16:56:36.959Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.964Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-0f59609f3e56380013710286: done: 0.025711 sec","job_status":"done","queue_duration_s":1.911371,"scheduling_latency_s":1.911385,"redis_calls":10,"redis_duration_s":0.001913,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025506,"duration_s":0.025711,"completed_at":"2026-10-02T16:56:38.901Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008565,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1876gitlab # [ 253.020243] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.902Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a79e7107867321560e1c340d","created_at":"2026-10-02T16:56:36.965Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.969Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a79e7107867321560e1c340d: start","job_status":"start","queue_duration_s":1.932468,"scheduling_latency_s":1.932481}1877gitlab # [ 253.021283] gitaly[901]: time="2026-10-02T16:56:39.046Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ diskcache=36536edf-da16-4cf9-a8cb-6b59d691e5f7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T22:56:39.035" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.035" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 253.021925] gitaly[901]: time="2026-10-02T16:56:39.047Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-02T22:56:39.035" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.035" grpc.time_ms=11.269 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.04 seconds)1880gitlab # [ 253.027091] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.917Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"a79e7107867321560e1c340d","created_at":"2026-10-02T16:56:36.965Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.969Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-a79e7107867321560e1c340d: done: 0.015026 sec","job_status":"done","queue_duration_s":1.932468,"scheduling_latency_s":1.932481,"redis_calls":10,"redis_duration_s":0.001877,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000369,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000294731,"duration_s":0.015026,"completed_at":"2026-10-02T16:56:38.917Z","load_balancing_strategy":"primary","db_duration_s":0.002046,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1881gitlab # [ 253.072372] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.918Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5321823b626adc99e33101f9","created_at":"2026-10-02T16:56:36.970Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.974Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5321823b626adc99e33101f9: start","job_status":"start","queue_duration_s":1.943747,"scheduling_latency_s":1.94376}1882gitlab # [ 253.079751] gitaly[901]: time="2026-10-02T16:56:39.077Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:09.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.076" grpc.time_ms=0.942 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 253.091626] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5321823b626adc99e33101f9","created_at":"2026-10-02T16:56:36.970Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.974Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5321823b626adc99e33101f9: done: 0.023953 sec","job_status":"done","queue_duration_s":1.943747,"scheduling_latency_s":1.94376,"redis_calls":10,"redis_duration_s":0.0018440000000000002,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000371,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001098,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025953,"duration_s":0.023953,"completed_at":"2026-10-02T16:56:38.942Z","load_balancing_strategy":"primary","db_duration_s":0.005674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1884gitlab # [ 253.131838] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.943Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"22e20fe3807e021477d3a5d0","created_at":"2026-10-02T16:56:36.979Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.982Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-22e20fe3807e021477d3a5d0: start","job_status":"start","queue_duration_s":1.960759,"scheduling_latency_s":1.960772}1885gitlab # [ 253.147661] nixbot[2659]: INFO: ::ffff:127.0.0.1:58022 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1886gitlab # [ 253.149191] gitaly[901]: time="2026-10-02T16:56:39.087Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T16:56:49.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:39.079" grpc.time_ms=7.76 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 253.192595] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:38.999Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"22e20fe3807e021477d3a5d0","created_at":"2026-10-02T16:56:36.979Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:36.982Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-22e20fe3807e021477d3a5d0: done: 0.056525 sec","job_status":"done","queue_duration_s":1.960759,"scheduling_latency_s":1.960772,"redis_calls":14,"redis_duration_s":0.003666,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000284394,"duration_s":0.056525,"completed_at":"2026-10-02T16:56:38.999Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011963,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1888gitlab # [ 253.237814] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.001Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"792eb5699953800bc349f2db","created_at":"2026-10-02T16:56:37.095Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.097Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-792eb5699953800bc349f2db: start","job_status":"start","queue_duration_s":1.903254,"scheduling_latency_s":1.90327}1889gitlab # [ 253.238770] gitaly[901]: time="2026-10-02T16:56:39.112Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:09.111" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.111" grpc.time_ms=0.774 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 253.239609] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.021Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"792eb5699953800bc349f2db","created_at":"2026-10-02T16:56:37.095Z","trace_propagation_headers":{"sentry-trace":"cfa7a01044fd4105bb2fa71e47336837-d481ed2d664d4b35","baggage":"sentry-trace_id=cfa7a01044fd4105bb2fa71e47336837,sentry-release=Unknown"},"correlation_id":"01M3YRPBM23YX4WREN4A967GX9","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.097Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-792eb5699953800bc349f2db: done: 0.020272 sec","job_status":"done","queue_duration_s":1.903254,"scheduling_latency_s":1.90327,"redis_calls":8,"redis_duration_s":0.00159,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001229,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000361,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020272,"completed_at":"2026-10-02T16:56:39.021Z","load_balancing_strategy":"primary","db_duration_s":0.003437,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1891gitlab # [ 253.264436] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.022Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c226da3592fe79d5cd55f5ae","created_at":"2026-10-02T16:56:37.177Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f862402e3d1e6f1b9f0e6cc9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.180Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c226da3592fe79d5cd55f5ae: start","job_status":"start","queue_duration_s":1.842156,"scheduling_latency_s":1.842173}1892gitlab # [ 253.305811] gitaly[901]: time="2026-10-02T16:56:39.117Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=28 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-02T16:57:09.115" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.115" grpc.time_ms=1.936 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 253.306760] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.058Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"c226da3592fe79d5cd55f5ae","created_at":"2026-10-02T16:56:37.177Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f862402e3d1e6f1b9f0e6cc9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.180Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-c226da3592fe79d5cd55f5ae: done: 0.036326 sec","job_status":"done","queue_duration_s":1.842156,"scheduling_latency_s":1.842173,"gitaly_calls":1,"gitaly_duration_s":0.0138,"redis_calls":12,"redis_duration_s":0.002155,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000458,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000842,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.023988244,"duration_s":0.036326,"completed_at":"2026-10-02T16:56:39.058Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1894gitlab # [ 253.356238] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.060Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"89e7d218f5f21f1aa4bfcf77","created_at":"2026-10-02T16:56:37.308Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:66569573dde7283aad584f1231afa8b442912456aee95ba17dc476b920d187d8","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.311Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-89e7d218f5f21f1aa4bfcf77: start","job_status":"start","queue_duration_s":1.74837,"scheduling_latency_s":1.748386}1895gitlab # [ 253.357107] gitaly[901]: time="2026-10-02T16:56:39.145Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:49.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:39.136" grpc.time_ms=9.231 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 253.548163] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 1113657497 wd_nsec: 11136573211897gitlab # [ 253.455560] gitaly[901]: time="2026-10-02T16:56:39.553Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQSTFS3W1HSB03HY4ABWV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.546" grpc.time_ms=7.497 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1898gitlab # [ 253.468719] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 511899gitlab # [ 253.479549] gitaly[901]: time="2026-10-02T16:56:39.577Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-02T16:57:09.565" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.566" grpc.time_ms=11.312 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 253.504093] gitaly[901]: time="2026-10-02T16:56:39.602Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQKQ6H8ZT00EBF09035RQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-02T16:57:09.592" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:39.592" grpc.time_ms=9.983 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901gitlab # [ 253.518168] sidekiq-cluster[2545]: {"severity":"WARN","time":"2026-10-02T16:56:39.616Z","class":"CreatePipelineWorker","correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"e152d76780f7c24d070a93cd291b650a5bec765b","after":"52641386fed9b3cfc34ef03d2f5d2c1030d9b27e","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"52641386fed9b3cfc34ef03d2f5d2c1030d9b27e","ref":"refs/heads/master"},"retry":0}1902gitlab # [ 253.524679] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"89e7d218f5f21f1aa4bfcf77","created_at":"2026-10-02T16:56:37.308Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:66569573dde7283aad584f1231afa8b442912456aee95ba17dc476b920d187d8","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.311Z","job_size_bytes":467,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-89e7d218f5f21f1aa4bfcf77: done: 0.562455 sec","job_status":"done","queue_duration_s":1.74837,"scheduling_latency_s":1.748386,"gitaly_calls":7,"gitaly_duration_s":0.06903,"redis_calls":33,"redis_duration_s":0.004227,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000488,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002036,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.466077,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.562455,"completed_at":"2026-10-02T16:56:39.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01968,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1903gitlab # [ 253.568507] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.666Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"a170e1a1-19e4-4cfb-b41d-6030e804f7c4\"}"],"class":"WebHookWorker","jid":"3d6f1f0f7d73956e0d501823","created_at":"2026-10-02T16:56:37.327Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77271796fcfd35052fd1d44bd6d259e57147eda748b75907f64423ff7d3be86e","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.329Z","job_size_bytes":1749,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3d6f1f0f7d73956e0d501823: start","job_status":"start","queue_duration_s":2.336736,"scheduling_latency_s":2.336772}1904gitlab # [ 253.591280] nixbot[2659]: INFO: ::ffff:127.0.0.1:58036 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1905gitlab # [ 253.603673] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.701Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"a170e1a1-19e4-4cfb-b41d-6030e804f7c4\"}"],"class":"WebHookWorker","jid":"3d6f1f0f7d73956e0d501823","created_at":"2026-10-02T16:56:37.327Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-6253cb5357704cf0","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:77271796fcfd35052fd1d44bd6d259e57147eda748b75907f64423ff7d3be86e","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.329Z","job_size_bytes":1749,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3d6f1f0f7d73956e0d501823: done: 0.034887 sec","job_status":"done","queue_duration_s":2.336736,"scheduling_latency_s":2.336772,"redis_calls":14,"redis_duration_s":0.002654,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000265,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001583,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0059390229999962685,"cpu_s":0.019924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.034887,"completed_at":"2026-10-02T16:56:39.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1906gitlab # [ 253.645555] gitaly[901]: time="2026-10-02T16:56:39.703Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQSW423R6CZQDQ88W2HFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.697" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1907gitlab # [ 253.646464] gitlab-workhorse[822]: time="2026-10-02T16:56:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671908gitlab # [ 253.646897] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1481909gitlab # [ 253.647587] gitaly[901]: time="2026-10-02T16:56:39.704Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQSW423R6CZQDQ88W2HFC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.697" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1910gitlab # [ 253.648255] gitaly[901]: time="2026-10-02T16:56:39.704Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQSW423R6CZQDQ88W2HFC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.697" grpc.time_ms=7.141 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1911gitlab # [ 253.687227] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"4e1dff25122d66233097fb37","created_at":"2026-10-02T16:56:37.417Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-df9464d2dde24617","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.421Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-4e1dff25122d66233097fb37: start","job_status":"start","queue_duration_s":2.363876,"scheduling_latency_s":2.363916}1912gitlab # [ 253.714194] gitaly[901]: time="2026-10-02T16:56:39.812Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQT0TD2EFCCJM7DSDQCD5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.799" pid=901 remote_ip="2001:db8:1::1" request_sha=9e70f408f5058f4235667a9019fe6fa6e6b67bc0 response_bytes=337 span.kind=server system=grpc1913gitlab # [ 253.723568] gitaly[901]: time="2026-10-02T16:56:39.812Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQT0TD2EFCCJM7DSDQCD5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.799" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1914gitlab # [ 253.736488] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"4e1dff25122d66233097fb37","created_at":"2026-10-02T16:56:37.417Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-df9464d2dde24617","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:37.421Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-4e1dff25122d66233097fb37: done: 0.049576 sec","job_status":"done","queue_duration_s":2.363876,"scheduling_latency_s":2.363916,"redis_calls":19,"redis_duration_s":0.003125,"redis_read_bytes":21,"redis_write_bytes":4287,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000679,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000384,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2258,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006796674,"duration_s":0.049576,"completed_at":"2026-10-02T16:56:39.834Z","load_balancing_strategy":"primary","db_duration_s":0.007049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1915gitlab # [ 253.737933] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.835Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4838ec6e4b71baf7e5253fad"],"class":"WebHooks::LogExecutionWorker","jid":"b79d19f1ba8b50fe76ee1076","created_at":"2026-10-02T16:56:38.530Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-866824b56a2c4536","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3897ba897af2891be378bed8383b36cf8370e87e8c8cc1e1facd5b7df96aa181","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:38.538Z","job_size_bytes":2591,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b79d19f1ba8b50fe76ee1076: start","job_status":"start","queue_duration_s":1.297129,"scheduling_latency_s":1.297146}1916gitlab # [ 253.778121] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.873Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4838ec6e4b71baf7e5253fad"],"class":"WebHooks::LogExecutionWorker","jid":"b79d19f1ba8b50fe76ee1076","created_at":"2026-10-02T16:56:38.530Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-866824b56a2c4536","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3897ba897af2891be378bed8383b36cf8370e87e8c8cc1e1facd5b7df96aa181","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:38.538Z","job_size_bytes":2591,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b79d19f1ba8b50fe76ee1076: done: 0.037381 sec","job_status":"done","queue_duration_s":1.297129,"scheduling_latency_s":1.297146,"redis_calls":10,"redis_duration_s":0.001627,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000367,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000957,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000247797,"duration_s":0.037381,"completed_at":"2026-10-02T16:56:39.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1917gitlab # [ 253.822831] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.874Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3d6f1f0f7d73956e0d501823"],"class":"WebHooks::LogExecutionWorker","jid":"1d74c37d27bd434c8bed7c63","created_at":"2026-10-02T16:56:39.691Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-10d6a3ac3d4e4f99","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:634282716b67e2738d9d2d44402b083182fd45b7a4ca6fdea40c4b42b62e1227","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:39.694Z","job_size_bytes":2591,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1d74c37d27bd434c8bed7c63: start","job_status":"start","queue_duration_s":0.179673,"scheduling_latency_s":0.179689}1918gitlab # [ 253.823830] gitaly[901]: time="2026-10-02T16:56:39.837Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1198 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQT0TD2EFCCJM7DSDQCD5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:39.799" grpc.time_ms=37.964 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1919gitlab # [ 253.824477] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.893Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3d6f1f0f7d73956e0d501823"],"class":"WebHooks::LogExecutionWorker","jid":"1d74c37d27bd434c8bed7c63","created_at":"2026-10-02T16:56:39.691Z","trace_propagation_headers":{"sentry-trace":"a93ada91876f4bf9960af305d9e4c56b-10d6a3ac3d4e4f99","baggage":"sentry-trace_id=a93ada91876f4bf9960af305d9e4c56b,sentry-release=Unknown"},"correlation_id":"01M3YRQKQ6H8ZT00EBF09035RQ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:634282716b67e2738d9d2d44402b083182fd45b7a4ca6fdea40c4b42b62e1227","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:39.694Z","job_size_bytes":2591,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1d74c37d27bd434c8bed7c63: done: 0.018835 sec","job_status":"done","queue_duration_s":0.179673,"scheduling_latency_s":0.179689,"redis_calls":7,"redis_duration_s":0.001691,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018835,"completed_at":"2026-10-02T16:56:39.893Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1920gitlab # [ 253.890912] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"b09949d376e5caed9cac69aa","created_at":"2026-10-02T16:56:39.822Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-7d453a20f2c14d69","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:39.827Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-b09949d376e5caed9cac69aa: start","job_status":"start","queue_duration_s":0.067172,"scheduling_latency_s":0.06719}1921gitlab # [ 253.891807] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:39.981Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"b09949d376e5caed9cac69aa","created_at":"2026-10-02T16:56:39.822Z","trace_propagation_headers":{"sentry-trace":"11487b018be54c7988269fdc6d1a94f2-7d453a20f2c14d69","baggage":"sentry-trace_id=11487b018be54c7988269fdc6d1a94f2,sentry-release=Unknown"},"correlation_id":"01M3YRP70AAK6PPZJJCGXNN9AP","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:39.827Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-b09949d376e5caed9cac69aa: done: 0.086575 sec","job_status":"done","queue_duration_s":0.067172,"scheduling_latency_s":0.06719,"redis_calls":11,"redis_duration_s":0.0021349999999999997,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000426,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024668,"duration_s":0.086575,"completed_at":"2026-10-02T16:56:39.981Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018722,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1922gitlab # [ 253.959756] gitlab-workhorse[822]: time="2026-10-02T16:56:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371923gitlab # [ 253.960505] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 3511924gitlab # [ 254.004300] nixbot[2659]: {"ts": "2026-10-02T16:56:40.102Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1925gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1926gitlab # [ 254.074566] gitaly[901]: time="2026-10-02T16:56:40.172Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTD26HV07XXX0NG5B19C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.164" grpc.time_ms=7.65 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1927gitlab # [ 254.074856] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 741928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.04 seconds)1929gitlab # [ 254.116046] nixbot[2659]: INFO: ::ffff:127.0.0.1:58048 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK1930gitlab # [ 254.129943] gitaly[901]: time="2026-10-02T16:56:40.228Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:10.227" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.227" grpc.time_ms=0.501 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1931gitlab # [ 254.153433] gitaly[901]: time="2026-10-02T16:56:40.251Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTG3QYNBA4645XZMNGF8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.244" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1932gitlab # [ 254.153959] gitaly[901]: time="2026-10-02T16:56:40.252Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTG3QYNBA4645XZMNGF8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.244" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1933gitlab # [ 254.154868] gitaly[901]: time="2026-10-02T16:56:40.253Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTG3QYNBA4645XZMNGF8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.244" grpc.time_ms=8.928 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1934gitlab # [ 254.155751] gitlab-workhorse[822]: time="2026-10-02T16:56:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671935gitlab # [ 254.156433] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 581936gitlab # [ 254.199119] gitaly[901]: time="2026-10-02T16:56:40.297Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:50.179" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.290" grpc.time_ms=7.149 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 254.250172] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.348Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a37286ddad955e9bb9ade591","created_at":"2026-10-02T16:56:40.338Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-0925f4fdf5114333","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.344Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a37286ddad955e9bb9ade591: start","job_status":"start","queue_duration_s":0.003827,"scheduling_latency_s":0.003869}1938gitlab # [ 254.267693] nixbot[2659]: {"ts": "2026-10-02T16:56:40.363Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1939gitlab # [ 254.267831] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2441940gitlab # [ 254.273591] gitaly[901]: time="2026-10-02T16:56:40.371Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTKW0ERSQW20S5J6BMTB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.360" grpc.time_ms=10.778 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1941gitlab # [ 254.286344] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 551942gitlab # [ 254.339077] gitaly[901]: time="2026-10-02T16:56:40.437Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTNGBEXY19T9JP2K966T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:10.436" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.436" grpc.time_ms=0.654 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943gitlab # [ 254.353864] gitaly[901]: time="2026-10-02T16:56:40.445Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:40.444" grpc.time_ms=0.348 pid=901 span.kind=server system=grpc1944gitlab # [ 254.386578] gitaly[901]: time="2026-10-02T16:56:40.484Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:40.483" grpc.time_ms=0.926 pid=901 span.kind=server system=grpc1945gitlab # [ 254.409851] gitaly[901]: time="2026-10-02T16:56:40.508Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTNGBEXY19T9JP2K966T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:50.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.499" grpc.time_ms=8.461 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 254.415746] gitaly[901]: time="2026-10-02T16:56:40.514Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTNQ1C6VDS1FAY6CAH85 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.501" pid=901 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1947gitlab # [ 254.416773] gitaly[901]: time="2026-10-02T16:56:40.514Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTNQ1C6VDS1FAY6CAH85 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.501" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1948gitlab # [ 254.417799] gitaly[901]: time="2026-10-02T16:56:40.514Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1160 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTNQ1C6VDS1FAY6CAH85 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.501" grpc.time_ms=12.931 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1949gitlab # [ 254.418705] gitlab-workhorse[822]: time="2026-10-02T16:56:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211950gitlab # [ 254.419722] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 1391951gitlab # [ 254.420992] gitaly[901]: time="2026-10-02T16:56:40.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:40.516" grpc.time_ms=0.408 pid=901 span.kind=server system=grpc1952gitlab # [ 254.480066] gitaly[901]: time="2026-10-02T16:56:40.578Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ diskcache=3251cb64-c850-4321-a774-fc5c235e6d3c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:10.419" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.420" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1953gitlab # [ 254.489835] gitaly[901]: time="2026-10-02T16:56:40.578Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=120 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7162 command.oublock=0 command.real_time_ms=150 command.spawn_token_fork_ms=0 command.system_time_ms=94 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:10.419" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.420" grpc.time_ms=157.97 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 254.530109] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2591955gitlab # [ 254.530949] gitaly[901]: time="2026-10-02T16:56:40.629Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:10.627" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.628" grpc.time_ms=1.069 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1956gitlab # [ 254.531822] nixbot[2659]: {"ts": "2026-10-02T16:56:40.630Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1957gitlab # [ 254.575617] gitaly[901]: time="2026-10-02T16:56:40.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:10.671" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.672" grpc.time_ms=0.524 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 254.584551] gitaly[901]: time="2026-10-02T16:56:40.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTXTG9QQTFJMSAVD2TJ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:10.681" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.682" grpc.time_ms=0.588 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 254.607080] gitaly[901]: time="2026-10-02T16:56:40.704Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:10.502" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.703" grpc.time_ms=1.004 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 254.623663] gitaly[901]: time="2026-10-02T16:56:40.722Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTXTG9QQTFJMSAVD2TJ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:50.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.711" grpc.time_ms=10.46 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 254.627435] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.724Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e224531edef81226631f6ec5","created_at":"2026-10-02T16:56:40.721Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"a37286ddad955e9bb9ade591","job_size_bytes":3,"pid":2545,"job_status":"deduplicated","message":"PipelineProcessWorker JID-e224531edef81226631f6ec5: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1962gitlab # [ 254.630075] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.727Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a37286ddad955e9bb9ade591","created_at":"2026-10-02T16:56:40.338Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-0925f4fdf5114333","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.344Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-a37286ddad955e9bb9ade591: rescheduled"}1963gitlab # [ 254.639386] gitaly[901]: time="2026-10-02T16:56:40.737Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=648 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-02T16:57:10.525" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.725" grpc.time_ms=12.227 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1964gitlab # [ 254.640524] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.737Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a37286ddad955e9bb9ade591","created_at":"2026-10-02T16:56:40.338Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-0925f4fdf5114333","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.344Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a37286ddad955e9bb9ade591: done: 0.38994 sec","job_status":"done","queue_duration_s":0.003827,"scheduling_latency_s":0.003869,"gitaly_calls":3,"gitaly_duration_s":0.183121,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018005,"redis_read_bytes":226,"redis_write_bytes":18466,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000408,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000696,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003382,"redis_queues_read_bytes":24,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.010234,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000223,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000418,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002236,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":18,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129418,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.299245295,"duration_s":0.38994,"completed_at":"2026-10-02T16:56:40.737Z","load_balancing_strategy":"primary","db_duration_s":0.050981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1965gitlab # [ 254.728495] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.742Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"02763f44f1018a893eff28d8","created_at":"2026-10-02T16:56:40.413Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.415Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-02763f44f1018a893eff28d8: start","job_status":"start","queue_duration_s":0.326559,"scheduling_latency_s":0.326595}1966gitlab # [ 254.745329] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.784Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"02763f44f1018a893eff28d8","created_at":"2026-10-02T16:56:40.413Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.415Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-02763f44f1018a893eff28d8: done: 0.042554 sec","job_status":"done","queue_duration_s":0.326559,"scheduling_latency_s":0.326595,"redis_calls":7,"redis_duration_s":0.001118,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00033,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042554,"completed_at":"2026-10-02T16:56:40.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006834,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1967gitlab # [ 254.786119] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1371968gitlab # [ 254.789765] gitaly[901]: time="2026-10-02T16:56:40.790Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=43 command.spawn_token_fork_ms=41 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:50.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.746" grpc.time_ms=44.729 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1969gitlab # [ 254.802797] nixbot[2659]: {"ts": "2026-10-02T16:56:40.773Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e152d76780f7c24d070a93cd291b650a5bec765b \"HTTP/1.1 201 Created\""}1970gitlab # [ 254.805877] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.786Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3bc9005ff57687e28bf043bb","created_at":"2026-10-02T16:56:40.583Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.585Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3bc9005ff57687e28bf043bb: start","job_status":"start","queue_duration_s":0.200038,"scheduling_latency_s":0.200057}1971gitlab # [ 254.822152] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.819Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3bc9005ff57687e28bf043bb","created_at":"2026-10-02T16:56:40.583Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.585Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3bc9005ff57687e28bf043bb: done: 0.033482 sec","job_status":"done","queue_duration_s":0.200038,"scheduling_latency_s":0.200057,"redis_calls":7,"redis_duration_s":0.0029370000000000004,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001975,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033482,"completed_at":"2026-10-02T16:56:40.819Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1972gitlab # [ 254.865094] gitaly[901]: time="2026-10-02T16:56:40.812Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-02T16:56:50.071" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:40.811" grpc.time_ms=0.176 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973gitlab # [ 254.876397] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 741974gitlab # [ 254.878518] gitlab-workhorse[822]: time="2026-10-02T16:56:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671975gitlab # [ 254.880406] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 641976gitlab # [ 254.882368] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"42674ee502958342ec776012","created_at":"2026-10-02T16:56:40.593Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.596Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-42674ee502958342ec776012: start","job_status":"start","queue_duration_s":0.228074,"scheduling_latency_s":0.2281}1977gitlab # [ 254.897499] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.849Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"42674ee502958342ec776012","created_at":"2026-10-02T16:56:40.593Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.596Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-42674ee502958342ec776012: done: 0.024764 sec","job_status":"done","queue_duration_s":0.228074,"scheduling_latency_s":0.2281,"redis_calls":7,"redis_duration_s":0.001098,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024764,"completed_at":"2026-10-02T16:56:40.849Z","load_balancing_strategy":"primary","db_duration_s":0.003096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1978gitlab # [ 254.937458] gitaly[901]: time="2026-10-02T16:56:40.878Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=54 command.spawn_token_fork_ms=49 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-02T16:56:50.082" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:40.822" grpc.time_ms=55.908 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1979gitlab # [ 254.950729] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.850Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"527285750f36c07a7539034f","created_at":"2026-10-02T16:56:40.603Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.605Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-527285750f36c07a7539034f: start","job_status":"start","queue_duration_s":0.244772,"scheduling_latency_s":0.244788}1980gitlab # [ 254.951095] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.884Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"527285750f36c07a7539034f","created_at":"2026-10-02T16:56:40.603Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.605Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-527285750f36c07a7539034f: done: 0.034617 sec","job_status":"done","queue_duration_s":0.244772,"scheduling_latency_s":0.244788,"redis_calls":10,"redis_duration_s":0.01406,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012556,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00043,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034617,"completed_at":"2026-10-02T16:56:40.884Z","load_balancing_strategy":"primary","db_duration_s":0.003462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 255.003364] gitaly[901]: time="2026-10-02T16:56:40.891Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=10 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQV3HRRGR78FVA71NK3JW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.860" grpc.time_ms=30.431 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1982gitlab # [ 255.004177] gitaly[901]: time="2026-10-02T16:56:40.931Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:40.930" grpc.time_ms=0.329 pid=901 span.kind=server system=grpc1983gitlab # [ 255.004889] nixbot[2659]: {"ts": "2026-10-02T16:56:41.058Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e \"HTTP/1.1 201 Created\""}1984gitlab # [ 255.005520] nixbot[2659]: {"ts": "2026-10-02T16:56:41.065Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-52641386fed9-4"}1985gitlab # [ 255.006034] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.887Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7d06f0a25759ac9b73facb43","created_at":"2026-10-02T16:56:40.605Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.607Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7d06f0a25759ac9b73facb43: start","job_status":"start","queue_duration_s":0.280051,"scheduling_latency_s":0.280071}1986gitlab # [ 255.006652] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.907Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7d06f0a25759ac9b73facb43","created_at":"2026-10-02T16:56:40.605Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.607Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7d06f0a25759ac9b73facb43: done: 0.019819 sec","job_status":"done","queue_duration_s":0.280051,"scheduling_latency_s":0.280071,"redis_calls":7,"redis_duration_s":0.001399,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019819,"completed_at":"2026-10-02T16:56:40.907Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 255.074344] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4651988gitlab # [ 255.075421] gitaly[901]: time="2026-10-02T16:56:40.956Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:40.955" grpc.time_ms=0.834 pid=901 span.kind=server system=grpc1989gitlab # [ 255.076026] gitaly[901]: time="2026-10-02T16:56:40.956Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQV5XBKZDSVNTYM05XN8J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.943" pid=901 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e'1991gitlab # [ 255.076644] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"09c919c826b1e7eda640820a","created_at":"2026-10-02T16:56:40.608Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.610Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-09c919c826b1e7eda640820a: start","job_status":"start","queue_duration_s":0.297682,"scheduling_latency_s":0.297698}1992gitlab # [ 255.079439] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"09c919c826b1e7eda640820a","created_at":"2026-10-02T16:56:40.608Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.610Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-09c919c826b1e7eda640820a: done: 0.027215 sec","job_status":"done","queue_duration_s":0.297682,"scheduling_latency_s":0.297698,"redis_calls":8,"redis_duration_s":0.00359,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003202,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027215,"completed_at":"2026-10-02T16:56:40.935Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 255.120346] nixbot[2659]: {"ts": "2026-10-02T16:56:41.158Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-52641386fed9-4", "argv0": "bwrap"}1994gitlab # [ 255.120900] gitaly[901]: time="2026-10-02T16:56:40.956Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQV5XBKZDSVNTYM05XN8J grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.943" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1995gitlab # [ 255.130703] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.937Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5d1711c524d37a5b6aeab822","created_at":"2026-10-02T16:56:40.612Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.614Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5d1711c524d37a5b6aeab822: start","job_status":"start","queue_duration_s":0.322757,"scheduling_latency_s":0.322779}1996gitlab # [ 255.146165] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.956Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"5d1711c524d37a5b6aeab822","created_at":"2026-10-02T16:56:40.612Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.614Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-5d1711c524d37a5b6aeab822: done: 0.019574 sec","job_status":"done","queue_duration_s":0.322757,"scheduling_latency_s":0.322779,"redis_calls":7,"redis_duration_s":0.002218,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019574,"completed_at":"2026-10-02T16:56:40.956Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 255.206830] gitaly[901]: time="2026-10-02T16:56:40.956Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQV5XBKZDSVNTYM05XN8J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-02T16:56:40.943" grpc.time_ms=12.602 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc1998gitlab # [ 255.207691] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.958Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e8b7c69e8cacff3ebe7a70ef","created_at":"2026-10-02T16:56:40.615Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.616Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e8b7c69e8cacff3ebe7a70ef: start","job_status":"start","queue_duration_s":0.342093,"scheduling_latency_s":0.342109}1999gitlab # [ 255.248264] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.982Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"e8b7c69e8cacff3ebe7a70ef","created_at":"2026-10-02T16:56:40.615Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.616Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-e8b7c69e8cacff3ebe7a70ef: done: 0.024333 sec","job_status":"done","queue_duration_s":0.342093,"scheduling_latency_s":0.342109,"redis_calls":7,"redis_duration_s":0.004443,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024333,"completed_at":"2026-10-02T16:56:40.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2000gitlab # [ 255.252211] gitaly[901]: time="2026-10-02T16:56:40.966Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ diskcache=8a61e470-a85a-4c1a-bf92-6325c6ba71bb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T16:56:50.146" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:40.886" pid=901 ref=refs/keep-around/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e remote_ip="2001:db8:1::1" revision=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e span.kind=server system=grpc username=root2001gitlab # [ 255.262756] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.984Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fbeb2fb59c7c00a619c9ea83","created_at":"2026-10-02T16:56:40.616Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.618Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fbeb2fb59c7c00a619c9ea83: start","job_status":"start","queue_duration_s":0.36619,"scheduling_latency_s":0.366206}2002gitlab # [ 255.313715] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"fbeb2fb59c7c00a619c9ea83","created_at":"2026-10-02T16:56:40.616Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.618Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-fbeb2fb59c7c00a619c9ea83: done: 0.00947 sec","job_status":"done","queue_duration_s":0.36619,"scheduling_latency_s":0.366206,"redis_calls":7,"redis_duration_s":0.001343,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.00947,"completed_at":"2026-10-02T16:56:40.993Z","load_balancing_strategy":"primary","db_duration_s":0.000283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 255.314968] gitaly[901]: time="2026-10-02T16:56:40.966Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=46 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5220 command.oublock=8 command.real_time_ms=71 command.spawn_token_fork_ms=2 command.system_time_ms=26 command.user_time_ms=20 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-02T16:56:50.146" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-02T16:56:40.886" grpc.time_ms=79.989 pid=901 ref=refs/keep-around/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e remote_ip="2001:db8:1::1" revision=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e span.kind=server system=grpc username=root2004gitlab # [ 255.361910] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:40.994Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2c353a10d81929eae8e27d5c","created_at":"2026-10-02T16:56:40.618Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.619Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2c353a10d81929eae8e27d5c: start","job_status":"start","queue_duration_s":0.375348,"scheduling_latency_s":0.375361}2005gitlab # [ 255.362112] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.010Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"2c353a10d81929eae8e27d5c","created_at":"2026-10-02T16:56:40.618Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.619Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-2c353a10d81929eae8e27d5c: done: 0.016068 sec","job_status":"done","queue_duration_s":0.375348,"scheduling_latency_s":0.375361,"redis_calls":7,"redis_duration_s":0.000965,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016068,"completed_at":"2026-10-02T16:56:41.010Z","load_balancing_strategy":"primary","db_duration_s":0.003507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 255.378810] gitaly[901]: time="2026-10-02T16:56:40.970Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:10.769" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:40.970" grpc.time_ms=0.387 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 255.390170] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.011Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e28e88e0925883849d14e358","created_at":"2026-10-02T16:56:40.727Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.729Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e28e88e0925883849d14e358: start","job_status":"start","queue_duration_s":0.282187,"scheduling_latency_s":0.282201}2008gitlab # [ 255.460696] nixbot[2659]: INFO: ::ffff:127.0.0.1:58050 - "GET /api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 200 OK2009gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', in 0.35 seconds)2010(finished: subtest: push delivers the webhook, in 50.12 seconds)2011subtest: eval and build post commit statuses2012gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses2013gitlab # [ 255.484239] gitaly[901]: time="2026-10-02T16:56:41.582Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:41.582" grpc.time_ms=0.245 pid=901 span.kind=server system=grpc2014gitlab # [ 255.506518] nix-daemon[2827]: accepted connection from pid 3650, user nixbot2015gitlab # [ 255.516802] gitaly[901]: time="2026-10-02T16:56:41.615Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:41.614" grpc.time_ms=0.304 pid=901 span.kind=server system=grpc2016gitlab # [ 255.540364] gitaly[901]: time="2026-10-02T16:56:41.638Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQVVH1NPE84H8PM9ZR7FM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:11.637" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:41.637" grpc.time_ms=0.648 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2017gitlab # [ 255.545582] gitaly[901]: time="2026-10-02T16:56:41.643Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:41.643" grpc.time_ms=0.704 pid=901 span.kind=server system=grpc2018gitlab # [ 255.561836] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 732019gitlab # [ 255.562614] gitaly[901]: time="2026-10-02T16:56:41.660Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:11.557" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:41.557" operations="[repack_refs]" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 255.563978] gitaly[901]: time="2026-10-02T16:56:41.662Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:11.557" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:41.557" pid=901 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-02 16:55:40.991794605 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2021gitlab # [ 255.573204] gitaly[901]: time="2026-10-02T16:56:41.669Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ diskcache=ffdcfbf4-0cb7-474f-bed1-d9c0eb3e85f5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:11.557" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:41.557" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 255.573932] gitaly[901]: time="2026-10-02T16:56:41.670Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7883 command.oublock=0 command.real_time_ms=107 command.spawn_token_fork_ms=2 command.system_time_ms=58 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:11.557" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:41.557" grpc.time_ms=112.374 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023gitlab # [ 255.578167] gitaly[901]: time="2026-10-02T16:56:41.676Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:11.557" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:41.557" pid=901 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2024gitlab # [ 255.578844] gitaly[901]: time="2026-10-02T16:56:41.676Z" level=info msg="optimized repository" clean_stale_data_time=13.767113ms clean_work_trees_time="67.048µs" commit_graph_time="3.631µs" correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.191µs" pid=901 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=13.94898ms2025gitlab # [ 255.582824] gitaly[901]: time="2026-10-02T16:56:41.676Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:11.557" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:41.557" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses, in 0.16 seconds)2027gitlab # [ 255.677899] gitaly[901]: time="2026-10-02T16:56:41.776Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:11.774" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:41.774" grpc.time_ms=1.108 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2028gitlab # [ 255.710649] gitaly[901]: time="2026-10-02T16:56:41.808Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTDPKQFBW86Q02S8KXGJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:11.807" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:41.807" grpc.time_ms=0.696 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 255.732388] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.829Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e28e88e0925883849d14e358","created_at":"2026-10-02T16:56:40.727Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.729Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-e28e88e0925883849d14e358: rescheduled"}2030gitlab # [ 255.752798] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.850Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e28e88e0925883849d14e358","created_at":"2026-10-02T16:56:40.727Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-21eb786503d641b6","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.729Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e28e88e0925883849d14e358: done: 0.839012 sec","job_status":"done","queue_duration_s":0.282187,"scheduling_latency_s":0.282201,"gitaly_calls":3,"gitaly_duration_s":0.180306,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.037957,"redis_read_bytes":149,"redis_write_bytes":18013,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001476,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000927,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002884,"redis_queues_read_bytes":27,"redis_queues_write_bytes":12312,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.017304,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000169,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000479,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.013242,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.522,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.51,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097164,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.784918195,"duration_s":0.839012,"completed_at":"2026-10-02T16:56:41.850Z","load_balancing_strategy":"primary","db_duration_s":0.524899,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2031gitlab # [ 255.802723] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.900Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6fc2bc19e5e3b5e747aebd32","created_at":"2026-10-02T16:56:40.972Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-174425735d3e4133","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.975Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6fc2bc19e5e3b5e747aebd32: start","job_status":"start","queue_duration_s":0.925073,"scheduling_latency_s":0.925106}2032gitlab # [ 255.867412] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.964Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6fc2bc19e5e3b5e747aebd32","created_at":"2026-10-02T16:56:40.972Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-174425735d3e4133","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.975Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6fc2bc19e5e3b5e747aebd32: done: 0.064402 sec","job_status":"done","queue_duration_s":0.925073,"scheduling_latency_s":0.925106,"redis_calls":7,"redis_duration_s":0.002676,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000676,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032822,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.064402,"completed_at":"2026-10-02T16:56:41.964Z","load_balancing_strategy":"primary","db_duration_s":0.007945,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2033gitlab # [ 255.869761] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:41.967Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d904397795ef78262ba91239","created_at":"2026-10-02T16:56:40.975Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-174425735d3e4133","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.977Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d904397795ef78262ba91239: start","job_status":"start","queue_duration_s":0.990415,"scheduling_latency_s":0.990456}2034gitlab # [ 255.938557] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.036Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d904397795ef78262ba91239","created_at":"2026-10-02T16:56:40.975Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-174425735d3e4133","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:40.977Z","job_size_bytes":65,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d904397795ef78262ba91239: done: 0.068776 sec","job_status":"done","queue_duration_s":0.990415,"scheduling_latency_s":0.990456,"redis_calls":10,"redis_duration_s":0.003776,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068776,"completed_at":"2026-10-02T16:56:42.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 255.939997] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.037Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"796b1476ce91902653d0cc2c","created_at":"2026-10-02T16:56:41.035Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-174425735d3e4133","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.038Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-796b1476ce91902653d0cc2c: start","job_status":"start","queue_duration_s":0.999268,"scheduling_latency_s":0.999286}2036gitlab # [ 255.998826] gitaly[901]: time="2026-10-02T16:56:42.097Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:12.095" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:42.096" grpc.time_ms=0.878 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 256.030095] gitaly[901]: time="2026-10-02T16:56:42.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQTWF7HW928S19X61N4RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:12.127" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:42.127" grpc.time_ms=0.904 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2038gitlab # [ 256.052197] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.149Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"796b1476ce91902653d0cc2c","created_at":"2026-10-02T16:56:41.035Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-174425735d3e4133","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.038Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-796b1476ce91902653d0cc2c: done: 0.111883 sec","job_status":"done","queue_duration_s":0.999268,"scheduling_latency_s":0.999286,"gitaly_calls":2,"gitaly_duration_s":0.00572,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008759,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001062,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001713,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.00032,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002234,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000261,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000864,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069211,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0783418,"duration_s":0.111883,"completed_at":"2026-10-02T16:56:42.149Z","load_balancing_strategy":"primary","db_duration_s":0.031957,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2039gitlab # [ 256.099898] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4517c2bd40b01d6890a879a6","created_at":"2026-10-02T16:56:41.550Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.552Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4517c2bd40b01d6890a879a6: start","job_status":"start","queue_duration_s":0.64491,"scheduling_latency_s":0.644961}2040gitlab # [ 256.173964] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.271Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"4517c2bd40b01d6890a879a6","created_at":"2026-10-02T16:56:41.550Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.552Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-4517c2bd40b01d6890a879a6: done: 0.074181 sec","job_status":"done","queue_duration_s":0.64491,"scheduling_latency_s":0.644961,"redis_calls":7,"redis_duration_s":0.001943,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001389,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074181,"completed_at":"2026-10-02T16:56:42.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010648,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2041gitlab # [ 256.175737] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.273Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"079304eb3c31b05e074e5702","created_at":"2026-10-02T16:56:41.734Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.736Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-079304eb3c31b05e074e5702: start","job_status":"start","queue_duration_s":0.537188,"scheduling_latency_s":0.537219}2042gitlab # [ 256.226186] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.298Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"079304eb3c31b05e074e5702","created_at":"2026-10-02T16:56:41.734Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.736Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-079304eb3c31b05e074e5702: done: 0.024617 sec","job_status":"done","queue_duration_s":0.537188,"scheduling_latency_s":0.537219,"redis_calls":7,"redis_duration_s":0.001943,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024617,"completed_at":"2026-10-02T16:56:42.298Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2043gitlab # [ 256.269298] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"22e96812acf5c1b4f087480e","created_at":"2026-10-02T16:56:41.740Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.744Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-22e96812acf5c1b4f087480e: start","job_status":"start","queue_duration_s":0.5546,"scheduling_latency_s":0.554617}2044gitlab # [ 256.270471] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.320Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"22e96812acf5c1b4f087480e","created_at":"2026-10-02T16:56:41.740Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.744Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-22e96812acf5c1b4f087480e: done: 0.021286 sec","job_status":"done","queue_duration_s":0.5546,"scheduling_latency_s":0.554617,"redis_calls":7,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021286,"completed_at":"2026-10-02T16:56:42.320Z","load_balancing_strategy":"primary","db_duration_s":0.005315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2045gitlab # [ 256.320401] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"767822b412773f1bd640a586","created_at":"2026-10-02T16:56:41.753Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.756Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-767822b412773f1bd640a586: start","job_status":"start","queue_duration_s":0.566063,"scheduling_latency_s":0.566079}2046gitlab # [ 256.321620] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.345Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"767822b412773f1bd640a586","created_at":"2026-10-02T16:56:41.753Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.756Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-767822b412773f1bd640a586: done: 0.023338 sec","job_status":"done","queue_duration_s":0.566063,"scheduling_latency_s":0.566079,"redis_calls":10,"redis_duration_s":0.002363,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000692,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000435,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023338,"completed_at":"2026-10-02T16:56:42.345Z","load_balancing_strategy":"primary","db_duration_s":0.005363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 256.374466] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.346Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bd0fb2630ff1ad2a3e218972","created_at":"2026-10-02T16:56:41.756Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.757Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bd0fb2630ff1ad2a3e218972: start","job_status":"start","queue_duration_s":0.589055,"scheduling_latency_s":0.589081}2048gitlab # [ 256.375719] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.366Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"bd0fb2630ff1ad2a3e218972","created_at":"2026-10-02T16:56:41.756Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.757Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-bd0fb2630ff1ad2a3e218972: done: 0.019435 sec","job_status":"done","queue_duration_s":0.589055,"scheduling_latency_s":0.589081,"redis_calls":7,"redis_duration_s":0.0017040000000000002,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001257,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019435,"completed_at":"2026-10-02T16:56:42.366Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2049gitlab # [ 256.402744] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.367Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8f9b3880bd6b0fbf0d1ada70","created_at":"2026-10-02T16:56:41.758Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.759Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8f9b3880bd6b0fbf0d1ada70: start","job_status":"start","queue_duration_s":0.607638,"scheduling_latency_s":0.607653}2050gitlab # [ 256.417313] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8f9b3880bd6b0fbf0d1ada70","created_at":"2026-10-02T16:56:41.758Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.759Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8f9b3880bd6b0fbf0d1ada70: done: 0.018421 sec","job_status":"done","queue_duration_s":0.607638,"scheduling_latency_s":0.607653,"redis_calls":8,"redis_duration_s":0.001907,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018421,"completed_at":"2026-10-02T16:56:42.385Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2051gitlab # [ 256.466895] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.387Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4b6b8738eb7c9654e23cdf66","created_at":"2026-10-02T16:56:41.760Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.761Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4b6b8738eb7c9654e23cdf66: start","job_status":"start","queue_duration_s":0.625251,"scheduling_latency_s":0.625266}2052gitlab # [ 256.469457] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.403Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"4b6b8738eb7c9654e23cdf66","created_at":"2026-10-02T16:56:41.760Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.761Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-4b6b8738eb7c9654e23cdf66: done: 0.016407 sec","job_status":"done","queue_duration_s":0.625251,"scheduling_latency_s":0.625266,"redis_calls":7,"redis_duration_s":0.001685,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000433,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016407,"completed_at":"2026-10-02T16:56:42.403Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002926,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2053gitlab # [ 256.510718] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.404Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4bb7bde1e6a15fa7f9627e0b","created_at":"2026-10-02T16:56:41.762Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.763Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4bb7bde1e6a15fa7f9627e0b: start","job_status":"start","queue_duration_s":0.641633,"scheduling_latency_s":0.641649}2054gitlab # [ 256.556478] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.424Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4bb7bde1e6a15fa7f9627e0b","created_at":"2026-10-02T16:56:41.762Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.763Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4bb7bde1e6a15fa7f9627e0b: done: 0.020166 sec","job_status":"done","queue_duration_s":0.641633,"scheduling_latency_s":0.641649,"redis_calls":7,"redis_duration_s":0.0016409999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001166,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020166,"completed_at":"2026-10-02T16:56:42.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 256.600660] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.426Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b738ea6ca9077cfa72a5c7c4","created_at":"2026-10-02T16:56:41.763Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.764Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b738ea6ca9077cfa72a5c7c4: start","job_status":"start","queue_duration_s":0.661713,"scheduling_latency_s":0.661727}2056gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses2057gitlab # [ 256.601735] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.436Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"b738ea6ca9077cfa72a5c7c4","created_at":"2026-10-02T16:56:41.763Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.764Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-b738ea6ca9077cfa72a5c7c4: done: 0.010175 sec","job_status":"done","queue_duration_s":0.661713,"scheduling_latency_s":0.661727,"redis_calls":7,"redis_duration_s":0.001624,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010175,"completed_at":"2026-10-02T16:56:42.436Z","load_balancing_strategy":"primary","db_duration_s":0.000491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2058gitlab # [ 256.641842] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.437Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"13b5e290fc1286c9845b2cf9","created_at":"2026-10-02T16:56:41.764Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.765Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-13b5e290fc1286c9845b2cf9: start","job_status":"start","queue_duration_s":0.671759,"scheduling_latency_s":0.671774}2059gitlab # [ 256.642732] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.454Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"13b5e290fc1286c9845b2cf9","created_at":"2026-10-02T16:56:41.764Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.765Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-13b5e290fc1286c9845b2cf9: done: 0.017006 sec","job_status":"done","queue_duration_s":0.671759,"scheduling_latency_s":0.671774,"redis_calls":7,"redis_duration_s":0.001651,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017006,"completed_at":"2026-10-02T16:56:42.454Z","load_balancing_strategy":"primary","db_duration_s":0.003473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2060gitlab # [ 256.703200] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.455Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c87afc1f96864be699f561ad","created_at":"2026-10-02T16:56:41.830Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.845Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c87afc1f96864be699f561ad: start","job_status":"start","queue_duration_s":0.61058,"scheduling_latency_s":0.610595}2061gitlab # [ 256.704417] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"c87afc1f96864be699f561ad","created_at":"2026-10-02T16:56:41.830Z","trace_propagation_headers":{"sentry-trace":"06d45e84f5f34580bd5345c466af1492-c44a0e6b65994cfd","baggage":"sentry-trace_id=06d45e84f5f34580bd5345c466af1492,sentry-release=Unknown"},"correlation_id":"01M3YRQTDPKQFBW86Q02S8KXGJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:41.845Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-c87afc1f96864be699f561ad: done: 0.018875 sec","job_status":"done","queue_duration_s":0.61058,"scheduling_latency_s":0.610595,"redis_calls":8,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018875,"completed_at":"2026-10-02T16:56:42.474Z","load_balancing_strategy":"primary","db_duration_s":0.003925,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2062gitlab # [ 256.722357] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"27c8413ad66b41c1a28265f8","created_at":"2026-10-02T16:56:42.082Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-e6148f6299eb4278","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:42.084Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-27c8413ad66b41c1a28265f8: start","job_status":"start","queue_duration_s":0.391284,"scheduling_latency_s":0.3913}2063gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses, in 0.16 seconds)2064gitlab # [ 256.768530] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:42.500Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"27c8413ad66b41c1a28265f8","created_at":"2026-10-02T16:56:42.082Z","trace_propagation_headers":{"sentry-trace":"c563a3e2cccb42f19a43f8bf0f49ee16-e6148f6299eb4278","baggage":"sentry-trace_id=c563a3e2cccb42f19a43f8bf0f49ee16,sentry-release=Unknown"},"correlation_id":"01M3YRQTWF7HW928S19X61N4RJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:42.084Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-27c8413ad66b41c1a28265f8: done: 0.024511 sec","job_status":"done","queue_duration_s":0.391284,"scheduling_latency_s":0.3913,"redis_calls":7,"redis_duration_s":0.001591,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000441,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024511,"completed_at":"2026-10-02T16:56:42.500Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2065gitlab # [ 256.813066] gitaly[901]: time="2026-10-02T16:56:42.841Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQX0WXF4HCC0J4FNPXDW5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:12.639" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:42.840" grpc.time_ms=0.887 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 256.814386] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:42 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1012067gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses2068gitlab # [ 257.888605] gitaly[901]: time="2026-10-02T16:56:43.985Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQY4KSW3J6YFC1B2PT4ZT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:13.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:43.984" grpc.time_ms=1.041 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 257.945173] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1182070gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses, in 0.16 seconds)2071gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses2072gitlab # [ 259.053895] gitaly[901]: time="2026-10-02T16:56:45.151Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRQZ8XS4X56H57895BTJJ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:15.149" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:45.150" grpc.time_ms=1.075 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 259.086087] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 982074gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses, in 0.14 seconds)2075gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses2076gitlab # [ 260.194394] gitaly[901]: time="2026-10-02T16:56:46.291Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR0CK23MJ9C3E30SS4PJK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:16.289" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:46.290" grpc.time_ms=1.002 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 260.220590] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 902078gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses, in 0.13 seconds)2079gitlab # [ 260.358256] nix-daemon[2827]: accepted connection from pid 3721, user nixbot2080gitlab # [ 260.371956] nix-daemon[2827]: accepted connection from pid 3650, user nixbot2081gitlab # [ 260.453936] gitaly[901]: time="2026-10-02T16:56:46.552Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:16.350" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:46.550" grpc.time_ms=0.939 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 260.539367] gitaly[901]: time="2026-10-02T16:56:46.637Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:56.274" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:46.624" grpc.time_ms=12.69 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 260.621987] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:46.719Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8ded538e2d65a64753ac5003","created_at":"2026-10-02T16:56:46.711Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-d99dcaf2fdb541f3","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.717Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8ded538e2d65a64753ac5003: start","job_status":"start","queue_duration_s":0.001813,"scheduling_latency_s":0.001863}2084gitlab # [ 260.659211] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2242085gitlab # [ 260.660514] nixbot[2659]: {"ts": "2026-10-02T16:56:46.755Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e \"HTTP/1.1 201 Created\""}2086gitlab # [ 260.727552] gitaly[901]: time="2026-10-02T16:56:46.825Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR0X8FG319PBP09K92A1W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:16.624" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:46.824" grpc.time_ms=0.745 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 260.763084] gitaly[901]: time="2026-10-02T16:56:46.861Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M3YRR0X8FG319PBP09K92A1W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:56.113" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:46.854" grpc.time_ms=7.091 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 260.791098] gitaly[901]: time="2026-10-02T16:56:46.889Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:46.889" grpc.time_ms=0.304 pid=901 span.kind=server system=grpc2089gitlab # [ 260.800371] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:46 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1372090gitlab # [ 260.801576] nixbot[2659]: {"ts": "2026-10-02T16:56:46.899Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e \"HTTP/1.1 201 Created\""}2091gitlab # [ 260.828619] gitaly[901]: time="2026-10-02T16:56:46.927Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:46.926" grpc.time_ms=0.312 pid=901 span.kind=server system=grpc2092gitlab # [ 260.853608] gitaly[901]: time="2026-10-02T16:56:46.951Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR121Q96WFPSGXHT22K9S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:16.750" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:46.951" grpc.time_ms=0.6 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2093gitlab # [ 260.869164] gitaly[901]: time="2026-10-02T16:56:46.967Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-02T16:56:46.967" grpc.time_ms=0.318 pid=901 span.kind=server system=grpc2094gitlab # [ 260.886933] gitaly[901]: time="2026-10-02T16:56:46.985Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 diskcache=eca483f2-1781-49a3-b142-12246756d914 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:16.819" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:46.819" pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 260.896747] gitaly[901]: time="2026-10-02T16:56:46.985Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7358 command.oublock=0 command.real_time_ms=156 command.spawn_token_fork_ms=1 command.system_time_ms=91 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-02T16:57:16.819" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:46.819" grpc.time_ms=165.419 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 260.901160] gitaly[901]: time="2026-10-02T16:56:46.999Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M3YRR121Q96WFPSGXHT22K9S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-02T16:56:56.251" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-02T16:56:46.992" grpc.time_ms=7.417 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 260.934280] gitaly[901]: time="2026-10-02T16:56:47.032Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-02T16:57:17.031" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:47.031" grpc.time_ms=0.798 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2098gitlab # [ 260.938834] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1232099gitlab # [ 260.940223] nixbot[2659]: {"ts": "2026-10-02T16:56:47.038Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e \"HTTP/1.1 201 Created\""}2100gitlab # [ 260.957040] gitaly[901]: time="2026-10-02T16:56:47.055Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR0NGY2QGN1MBJ1V5HA42 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:17.054" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:47.054" grpc.time_ms=0.473 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 260.969671] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.061Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"09f9b9d58cbc30df04dbee2a","created_at":"2026-10-02T16:56:47.060Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"8ded538e2d65a64753ac5003","job_size_bytes":3,"pid":2545,"job_status":"deduplicated","message":"PipelineProcessWorker JID-09f9b9d58cbc30df04dbee2a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2102gitlab # [ 260.969995] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.063Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8ded538e2d65a64753ac5003","created_at":"2026-10-02T16:56:46.711Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-d99dcaf2fdb541f3","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.717Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2545,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8ded538e2d65a64753ac5003: rescheduled"}2103gitlab # [ 260.970536] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.067Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8ded538e2d65a64753ac5003","created_at":"2026-10-02T16:56:46.711Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-d99dcaf2fdb541f3","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.717Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8ded538e2d65a64753ac5003: done: 0.34899 sec","job_status":"done","queue_duration_s":0.001813,"scheduling_latency_s":0.001863,"gitaly_calls":3,"gitaly_duration_s":0.172498,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.02224,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001672,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001025,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.003237,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.006039,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000318,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000451,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.007826,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118417,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.301328521,"duration_s":0.34899,"completed_at":"2026-10-02T16:56:47.067Z","load_balancing_strategy":"primary","db_duration_s":0.039698,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2104gitlab # [ 261.046199] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.144Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8de820b12c3800a723c93af0","created_at":"2026-10-02T16:56:46.810Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.812Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8de820b12c3800a723c93af0: start","job_status":"start","queue_duration_s":0.331102,"scheduling_latency_s":0.331137}2105gitlab # [ 261.083918] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.181Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"8de820b12c3800a723c93af0","created_at":"2026-10-02T16:56:46.810Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.812Z","job_size_bytes":23,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-8de820b12c3800a723c93af0: done: 0.037897 sec","job_status":"done","queue_duration_s":0.331102,"scheduling_latency_s":0.331137,"redis_calls":7,"redis_duration_s":0.00273,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037897,"completed_at":"2026-10-02T16:56:47.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007253,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2106gitlab # [ 261.105853] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.193Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2da72d8fdbfcccb044a764ed","created_at":"2026-10-02T16:56:46.989Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.991Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2da72d8fdbfcccb044a764ed: start","job_status":"start","queue_duration_s":0.202233,"scheduling_latency_s":0.202264}2107gitlab # [ 261.162985] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.260Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2da72d8fdbfcccb044a764ed","created_at":"2026-10-02T16:56:46.989Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:46.991Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2da72d8fdbfcccb044a764ed: done: 0.067095 sec","job_status":"done","queue_duration_s":0.202233,"scheduling_latency_s":0.202264,"redis_calls":7,"redis_duration_s":0.005665999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00323,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067095,"completed_at":"2026-10-02T16:56:47.260Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2108gitlab # [ 261.166691] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"68018240e0a66963e6782156","created_at":"2026-10-02T16:56:46.998Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.001Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-68018240e0a66963e6782156: start","job_status":"start","queue_duration_s":0.26386,"scheduling_latency_s":0.263885}2109gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses2110gitlab # [ 261.192811] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"68018240e0a66963e6782156","created_at":"2026-10-02T16:56:46.998Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.001Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-68018240e0a66963e6782156: done: 0.026099 sec","job_status":"done","queue_duration_s":0.26386,"scheduling_latency_s":0.263885,"redis_calls":7,"redis_duration_s":0.0022630000000000003,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00124,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026099,"completed_at":"2026-10-02T16:56:47.290Z","load_balancing_strategy":"primary","db_duration_s":0.003351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2111gitlab # [ 261.237977] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.296Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5b0473a8e8e21a41d0adac64","created_at":"2026-10-02T16:56:47.008Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.011Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5b0473a8e8e21a41d0adac64: start","job_status":"start","queue_duration_s":0.285655,"scheduling_latency_s":0.285681}2112gitlab # [ 261.238723] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"5b0473a8e8e21a41d0adac64","created_at":"2026-10-02T16:56:47.008Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.011Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5b0473a8e8e21a41d0adac64: done: 0.025244 sec","job_status":"done","queue_duration_s":0.285655,"scheduling_latency_s":0.285681,"redis_calls":10,"redis_duration_s":0.001733,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000544,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025244,"completed_at":"2026-10-02T16:56:47.321Z","load_balancing_strategy":"primary","db_duration_s":0.003719,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2113gitlab # [ 261.288040] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.323Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c5de61b5ce9f49adf212aba6","created_at":"2026-10-02T16:56:47.011Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.012Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c5de61b5ce9f49adf212aba6: start","job_status":"start","queue_duration_s":0.310635,"scheduling_latency_s":0.310658}2114gitlab # [ 261.290138] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"c5de61b5ce9f49adf212aba6","created_at":"2026-10-02T16:56:47.011Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.012Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-c5de61b5ce9f49adf212aba6: done: 0.030647 sec","job_status":"done","queue_duration_s":0.310635,"scheduling_latency_s":0.310658,"redis_calls":7,"redis_duration_s":0.003993,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000293,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030647,"completed_at":"2026-10-02T16:56:47.353Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 261.330205] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f316808d36ac1bd5e0a997a4","created_at":"2026-10-02T16:56:47.012Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.014Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f316808d36ac1bd5e0a997a4: start","job_status":"start","queue_duration_s":0.342153,"scheduling_latency_s":0.342172}2116gitlab # [ 261.372109] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"f316808d36ac1bd5e0a997a4","created_at":"2026-10-02T16:56:47.012Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.014Z","job_size_bytes":19,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-f316808d36ac1bd5e0a997a4: done: 0.084564 sec","job_status":"done","queue_duration_s":0.342153,"scheduling_latency_s":0.342172,"redis_calls":8,"redis_duration_s":0.009137,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003105,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.084564,"completed_at":"2026-10-02T16:56:47.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2117gitlab # [ 261.418997] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.442Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ab38dddf370c277ad3bef84e","created_at":"2026-10-02T16:56:47.015Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.015Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ab38dddf370c277ad3bef84e: start","job_status":"start","queue_duration_s":0.426787,"scheduling_latency_s":0.426812}2118gitlab # [ 261.419772] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.467Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ab38dddf370c277ad3bef84e","created_at":"2026-10-02T16:56:47.015Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.015Z","job_size_bytes":66,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ab38dddf370c277ad3bef84e: done: 0.025018 sec","job_status":"done","queue_duration_s":0.426787,"scheduling_latency_s":0.426812,"redis_calls":7,"redis_duration_s":0.001299,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025018,"completed_at":"2026-10-02T16:56:47.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010116,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2119gitlab # [ 261.466431] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ded6079dd10bc5907c147bc3","created_at":"2026-10-02T16:56:47.016Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.017Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ded6079dd10bc5907c147bc3: start","job_status":"start","queue_duration_s":0.451155,"scheduling_latency_s":0.45117}2120gitlab # [ 261.467530] gitaly[901]: time="2026-10-02T16:56:47.516Z" level=info msg="finished unary call with code OK" catfile.duration_ms=72 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=72 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M3YRR1G0HCE3JVDKFXKKKM4Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-02T16:57:17.242" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-02T16:56:47.442" grpc.time_ms=73.113 pid=901 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses, in 0.30 seconds)2122(finished: subtest: eval and build post commit statuses, in 6.06 seconds)2123(finished: run the VM test script, in 311.89 seconds)2124gitlab # [ 261.468511] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"ded6079dd10bc5907c147bc3","created_at":"2026-10-02T16:56:47.016Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.017Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-ded6079dd10bc5907c147bc3: done: 0.022055 sec","job_status":"done","queue_duration_s":0.451155,"scheduling_latency_s":0.45117,"redis_calls":7,"redis_duration_s":0.000974,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022055,"completed_at":"2026-10-02T16:56:47.490Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005053,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2125gitlab # [ 261.510695] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.491Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"3dd6405be5662bb570b3d6a7","created_at":"2026-10-02T16:56:47.020Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.021Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3dd6405be5662bb570b3d6a7: start","job_status":"start","queue_duration_s":0.470671,"scheduling_latency_s":0.470685}2126gitlab # [ 261.516577] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.507Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"3dd6405be5662bb570b3d6a7","created_at":"2026-10-02T16:56:47.020Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.021Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3dd6405be5662bb570b3d6a7: done: 0.015709 sec","job_status":"done","queue_duration_s":0.470671,"scheduling_latency_s":0.470685,"redis_calls":7,"redis_duration_s":0.001029,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000343,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015709,"completed_at":"2026-10-02T16:56:47.507Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2127gitlab # [ 261.564431] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.508Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ea8c59e07dab8d1503d37b76","created_at":"2026-10-02T16:56:47.021Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.022Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ea8c59e07dab8d1503d37b76: start","job_status":"start","queue_duration_s":0.485843,"scheduling_latency_s":0.485857}2128gitlab # [ 261.576408] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.578Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ea8c59e07dab8d1503d37b76","created_at":"2026-10-02T16:56:47.021Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.022Z","job_size_bytes":6,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ea8c59e07dab8d1503d37b76: done: 0.070547 sec","job_status":"done","queue_duration_s":0.485843,"scheduling_latency_s":0.485857,"redis_calls":7,"redis_duration_s":0.001026,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063434,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.070547,"completed_at":"2026-10-02T16:56:47.578Z","load_balancing_strategy":"primary","db_duration_s":0.000236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2129gitlab # [ 261.617673] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.580Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"42583ee26a3e84accb20f601","created_at":"2026-10-02T16:56:47.023Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.024Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-42583ee26a3e84accb20f601: start","job_status":"start","queue_duration_s":0.555696,"scheduling_latency_s":0.555714}2130gitlab # [ 261.627070] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/02:16:56:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/52641386fed9b3cfc34ef03d2f5d2c1030d9b27e/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 2602131test script finished in 312.05s2132cleanup2133kill QemuMachine (pid 46)2134gitlab # [ 261.629137] sidekiq-cluster[2545]: {"severity":"INFO","time":"2026-10-02T16:56:47.629Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"42583ee26a3e84accb20f601","created_at":"2026-10-02T16:56:47.023Z","trace_propagation_headers":{"sentry-trace":"71b567d9b9cf4e1589bd6ef2df1bd6fc-6e41066b4ad64cae","baggage":"sentry-trace_id=71b567d9b9cf4e1589bd6ef2df1bd6fc,sentry-release=Unknown"},"correlation_id":"01M3YRR0NGY2QGN1MBJ1V5HA42","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-02T16:56:47.024Z","job_size_bytes":3,"pid":2545,"sidekiq_tid":"m7xh","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-42583ee26a3e84accb20f601: done: 0.049819 sec","job_status":"done","queue_duration_s":0.555696,"scheduling_latency_s":0.555714,"redis_calls":7,"redis_duration_s":0.005498,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_cqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2135gitlab # o2136(finished: cleanup, in 1.45 seconds)2137additionally exposed symbols:2138 gitlab,2139 vlan1,2140 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2141[]2142[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-02T16:55:50.516Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2143[]2144[]2145[]2146[]2147[]2148[]2149[]2150[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-02T16:56:40.582619Z', 'started_at': '2026-10-02T16:56:41.062657Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2151[{'id': 5, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T16:56:41.029Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2152[{'id': 5, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T16:56:41.029Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2153[{'id': 5, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T16:56:41.029Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2154[{'id': 5, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T16:56:41.029Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2155[{'id': 5, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-02T16:56:41.029Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2156[{'id': 5, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-02T16:56:41.029Z', 'started_at': None, 'finished_at': '2026-10-02T16:56:46.698Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '52641386fed9b3cfc34ef03d2f5d2c1030d9b27e', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-02T16:56:46.878Z', 'started_at': None, 'finished_at': '2026-10-02T16:56:47.014Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]