vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #437
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.CB85adxEvP', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 50.68 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: ab60c868-3ebe-4919-b5a2-75142e7ce4d118gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/imxyqan0p5i53x33i4bbv0dikhqkda0x-nixos-system-gitlab-test/init regInfo=/nix/store/bxzcf628ny7q4ych2v370ilxx7nxijb6-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000001] kvm-clock: using sched offset of 518886618 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000804] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000830] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000832] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000875] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002726] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002738] Using GB pages for direct mapping73gitlab # [ 0.002877] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002884] ACPI: Early table checksum verification disabled75gitlab # [ 0.002887] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002891] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002895] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002901] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002903] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002904] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002906] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002908] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002909] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002910] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002910] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002911] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002911] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002912] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003126] No NUMA configuration found90gitlab # [ 0.003127] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003129] NODE_DATA(0) allocated [mem 0x1bfff8780-0x1bfffdcff]92gitlab # [ 0.005466] Zone ranges:93gitlab # [ 0.005467] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005468] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005469] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005470] Device empty97gitlab # [ 0.005471] Movable zone start for each node98gitlab # [ 0.005472] Early memory node ranges99gitlab # [ 0.005472] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005473] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005474] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005475] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005495] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005764] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.109743] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.110170] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.110185] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.110215] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.110218] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.110220] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.110221] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.110222] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.110222] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.110225] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.110226] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.110231] TSC deadline timer available117gitlab # [ 0.110235] CPU topo: Max. logical packages: 1118gitlab # [ 0.110236] CPU topo: Max. logical dies: 1119gitlab # [ 0.110237] CPU topo: Max. dies per package: 1120gitlab # [ 0.110240] CPU topo: Max. threads per core: 1121gitlab # [ 0.110241] CPU topo: Num. cores per package: 4122gitlab # [ 0.110241] CPU topo: Num. threads per package: 4123gitlab # [ 0.110241] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.110265] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.110281] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.110284] kvm-guest: setup PV sched yield127gitlab # [ 0.110299] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.110301] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.110302] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.110304] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.110305] Booting paravirtualized kernel on KVM132gitlab # [ 0.110309] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.114751] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.116916] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.116964] kvm-guest: PV spinlocks enabled136gitlab # [ 0.116966] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.116968] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/imxyqan0p5i53x33i4bbv0dikhqkda0x-nixos-system-gitlab-test/init regInfo=/nix/store/bxzcf628ny7q4ych2v370ilxx7nxijb6-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.117064] Unknown kernel command line parameters "regInfo=/nix/store/bxzcf628ny7q4ych2v370ilxx7nxijb6-closure-info/registration", will be passed to user space.139gitlab # [ 0.117077] random: crng init done140gitlab # [ 0.117078] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.125765] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.129953] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.130026] software IO TLB: area num 4.144gitlab # [ 0.200902] Fallback order for Node 0: 0145gitlab # [ 0.200911] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.200913] Policy zone: Normal147gitlab # [ 0.203535] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.212799] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.225805] allocated 12582912 bytes of page_ext150gitlab # [ 0.235820] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.235822] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.236682] Dynamic Preempt: lazy153gitlab # [ 0.236880] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.236881] rcu: RCU event tracing is enabled.155gitlab # [ 0.236882] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.236883] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.236884] Rude variant of Tasks RCU enabled.158gitlab # [ 0.236884] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.236885] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.236886] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.236911] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.236913] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.236914] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.241231] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.241562] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.241570] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.241683] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.245269] Console: colour VGA+ 80x25169gitlab # [ 0.245272] printk: legacy console [tty0] enabled170gitlab # [ 0.276243] printk: legacy console [ttyS0] enabled171gitlab # [ 0.384655] ACPI: Core revision 20250807172gitlab # [ 0.385631] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.387228] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.388279] x2apic enabled175gitlab # [ 0.389040] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.390023] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.391310] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.392822] kvm-guest: setup PV IPIs179gitlab # [ 0.394440] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.395519] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.397327] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.398417] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.399443] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.401324] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.402328] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.403325] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.404325] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.406113] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.407087] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.408145] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.409332] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.410137] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.412328] active return thunk: srso_alias_return_thunk194gitlab # [ 0.413400] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.415325] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.416325] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.417325] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.418325] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.420325] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.421324] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.422326] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.423325] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.425191] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.426325] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.427325] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.428324] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.458531] Freeing SMP alternatives memory: 44K208gitlab # [ 0.459327] pid_max: default: 32768 minimum: 301209gitlab # [ 0.460353] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.461427] landlock: Up and running.211gitlab # [ 0.462089] Yama: becoming mindful.212gitlab # [ 0.462995] LSM support for eBPF active213gitlab # [ 0.463543] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.464472] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.467208] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.467878] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.468329] ... version: 2218gitlab # [ 0.469082] ... bit width: 48219gitlab # [ 0.469327] ... generic counters: 6220gitlab # [ 0.470100] ... generic bitmap: 000000000000003f221gitlab # [ 0.470378] ... fixed-purpose counters: 0222gitlab # [ 0.471157] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.472088] ... value mask: 0000ffffffffffff224gitlab # [ 0.472327] ... max period: 00007fffffffffff225gitlab # [ 0.473292] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.474205] signal: max sigframe size: 3376227gitlab # [ 0.474944] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.475330] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.476426] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.482243] smp: Bringing up secondary CPUs ...231gitlab # [ 0.483379] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.484257] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.487442] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.489231] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.490469] Memory: 6011560K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260108K reserved, 0K cma-reserved)236gitlab # [ 0.492328] devtmpfs: initialized237gitlab # [ 0.493162] x86/mm: Memory block size: 128MB238gitlab # [ 0.496509] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.497402] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.498426] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.499600] PM: RTC time: 16:08:30, date: 2026-10-08242gitlab # [ 0.503304] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.505660] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.506383] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.508399] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.509339] audit: initializing netlink subsys (disabled)247gitlab # [ 0.510455] audit: type=2000 audit(1791475710.217:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.510617] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.512328] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.513329] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.514327] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.515326] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.516344] cpuidle: using governor menu254gitlab # [ 0.518529] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.519590] PCI: Using configuration type 1 for base access256gitlab # [ 0.520328] PCI: Using configuration type 1 for extended access257gitlab # [ 0.521461] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.524368] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.525328] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.526328] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.527327] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.532409] ACPI: Added _OSI(Module Device)263gitlab # [ 0.534336] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.536334] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.543518] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.549601] ACPI: Interpreter enabled267gitlab # [ 0.550344] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.551119] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.551364] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.552332] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.554877] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.568769] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.571345] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.575697] acpiphp: Slot [3] registered275gitlab # [ 0.577450] acpiphp: Slot [4] registered276gitlab # [ 0.579402] acpiphp: Slot [5] registered277gitlab # [ 0.581399] acpiphp: Slot [6] registered278gitlab # [ 0.583400] acpiphp: Slot [7] registered279gitlab # [ 0.585425] acpiphp: Slot [8] registered280gitlab # [ 0.587379] acpiphp: Slot [9] registered281gitlab # [ 0.588382] acpiphp: Slot [10] registered282gitlab # [ 0.590387] acpiphp: Slot [11] registered283gitlab # [ 0.591433] acpiphp: Slot [12] registered284gitlab # [ 0.593384] acpiphp: Slot [13] registered285gitlab # [ 0.594374] acpiphp: Slot [14] registered286gitlab # [ 0.596392] acpiphp: Slot [15] registered287gitlab # [ 0.597375] acpiphp: Slot [16] registered288gitlab # [ 0.599373] acpiphp: Slot [17] registered289gitlab # [ 0.600371] acpiphp: Slot [18] registered290gitlab # [ 0.602391] acpiphp: Slot [19] registered291gitlab # [ 0.603386] acpiphp: Slot [20] registered292gitlab # [ 0.605370] acpiphp: Slot [21] registered293gitlab # [ 0.606350] acpiphp: Slot [22] registered294gitlab # [ 0.607128] acpiphp: Slot [23] registered295gitlab # [ 0.607350] acpiphp: Slot [24] registered296gitlab # [ 0.608096] acpiphp: Slot [25] registered297gitlab # [ 0.609347] acpiphp: Slot [26] registered298gitlab # [ 0.610121] acpiphp: Slot [27] registered299gitlab # [ 0.610347] acpiphp: Slot [28] registered300gitlab # [ 0.611065] acpiphp: Slot [29] registered301gitlab # [ 0.612360] acpiphp: Slot [30] registered302gitlab # [ 0.613129] acpiphp: Slot [31] registered303gitlab # [ 0.613342] PCI host bridge to bus 0000:00304gitlab # [ 0.614067] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.615332] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.616328] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.618378] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.621338] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.624360] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.627183] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.632964] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.637491] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.644406] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.646403] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.649334] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.651333] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.654335] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.657784] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.663419] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.668798] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.671897] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.674344] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.676836] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.693506] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.694361] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.695350] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.696714] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.699391] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.704362] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.705319] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.706134] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.719328] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.721966] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.727641] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.729335] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.730349] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.732618] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.735335] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.736335] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.738350] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.740582] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.744355] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.745286] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.746136] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.748809] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.752329] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.753265] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.754160] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.756583] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.765403] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.767365] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.770389] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.778364] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.787359] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.789351] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.791391] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.795353] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.800927] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.809660] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.812391] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.817982] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.825381] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.827346] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.829368] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.832761] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.837356] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.838291] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.839153] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.844808] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.845495] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.847480] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.848467] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.849404] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.852402] iommu: Default domain type: Translated375gitlab # [ 0.853231] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.854615] ACPI: bus type USB registered377gitlab # [ 0.855394] usbcore: registered new interface driver usbfs378gitlab # [ 0.856350] usbcore: registered new interface driver hub379gitlab # [ 0.857308] usbcore: registered new device driver usb380gitlab # [ 0.859323] NetLabel: Initializing381gitlab # [ 0.859323] NetLabel: domain hash size = 128382gitlab # [ 0.860918] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.862371] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.863337] PCI: Using ACPI for IRQ routing385gitlab # [ 0.864511] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.865323] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.865323] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.868332] vgaarb: loaded389gitlab # [ 0.869081] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.869975] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.874425] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.876070] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.876865] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.878352] pnp: PnP ACPI init395gitlab # [ 0.879496] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.889797] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.891489] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.892527] NET: Registered PF_INET protocol family399gitlab # [ 0.894584] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.912172] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.913707] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.915555] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.925645] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.929065] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.933272] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.937313] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.940929] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.944464] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.947121] NET: Registered PF_XDP protocol family410gitlab # [ 0.949266] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.951850] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.954397] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.957232] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.959920] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.962521] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.964480] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.969429] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.974547] PCI: CLS 0 bytes, default 64419gitlab # [ 0.975377] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.975959] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.976482] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.979398] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 1.001675] Initialise system trusted keyrings424gitlab # [ 1.002917] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.014453] Key type asymmetric registered426gitlab # [ 1.015208] Asymmetric key parser 'x509' registered427gitlab # [ 1.016225] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.017889] io scheduler mq-deadline registered429gitlab # [ 1.018706] io scheduler kyber registered430gitlab # [ 1.022617] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.024040] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.026705] Linux agpgart interface v0.103433gitlab # [ 1.027543] ACPI: bus type drm_connector registered434gitlab # [ 1.030585] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.031742] usbserial: USB Serial support registered for generic436gitlab # [ 1.032818] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.032818] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.035217] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.036691] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.037970] NET: Registered PF_INET6 protocol family441gitlab # [ 1.039863] Segment Routing with IPv6442gitlab # [ 1.040583] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.043359] IPI shorthand broadcast: enabled444gitlab # [ 1.047735] sched_clock: Marking stable (900012224, 146753621)->(1075552432, -28786587)445gitlab # [ 1.049700] registered taskstats version 1446gitlab # [ 1.050782] Loading compiled-in X.509 certificates447gitlab # [ 1.061014] Demotion targets for Node 0: null448gitlab # [ 1.062215] Key type .fscrypt registered449gitlab # [ 1.062960] Key type fscrypt-provisioning registered450gitlab # [ 1.063961] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.064937] ima: Allocated hash algorithm: sha1452gitlab # [ 1.065806] ima: No architecture policies found453gitlab # [ 1.066932] PM: Magic number: 14:387:135454gitlab # [ 1.068598] RAS: Correctable Errors collector initialized.455gitlab # [ 1.073647] clk: Disabling unused clocks456gitlab # [ 1.074473] PM: genpd: Disabling unused power domains457gitlab # [ 1.322678] Freeing initrd memory: 29392K458gitlab # [ 1.329641] Freeing unused decrypted memory: 2028K459gitlab # [ 1.335968] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.338609] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.343419] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.347303] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.415271] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.416446] Run /init as init process465gitlab # [ 1.431025] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.454271] fuse: init (API version 7.45)467gitlab # [ 1.462379] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.469532] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.472822] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.510984] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.846910] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.884440] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.886655] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.888871] systemd[1]: Running in initrd.475gitlab # [ 1.891397] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.894371] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 2.006930] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 2.046861] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 2.062377] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 2.063588] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 2.065054] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 2.066257] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 2.067371] systemd[1]: Reached target Path Units.484gitlab # [ 2.068261] systemd[1]: Reached target Slice Units.485gitlab # [ 2.069174] systemd[1]: Reached target Swaps.486gitlab # [ 2.070048] systemd[1]: Reached target Timer Units.487gitlab # [ 2.071084] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 2.072327] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 2.073469] systemd[1]: Listening on Journal Sockets.490gitlab # [ 2.074505] systemd[1]: Listening on udev Control Socket.491gitlab # [ 2.075539] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 2.076531] systemd[1]: Reached target Socket Units.493gitlab # [ 2.078536] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 2.080779] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 2.082822] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.087844] systemd[1]: Starting Journal Service...497gitlab # [ 2.090117] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.092840] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.097884] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.104889] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.108878] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.112837] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.114744] systemd-journald[90]: Collecting audit messages is disabled.504gitlab # [ 2.116558] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.124978] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.146155] netfs: FS-Cache loaded507gitlab # [ 2.154145] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.508gitlab # [ 2.156483] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.509gitlab # [ 2.159392] systemd[1]: Starting Create Static Device Nodes in /dev...510gitlab # [ 2.164979] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev511gitlab # [ 2.165129] 9pnet: Installing 9P2000 support512gitlab # [ 2.169625] systemd[1]: Finished Load Kernel Modules.513gitlab # [ 2.172532] systemd[1]: Starting Apply Kernel Variables...514gitlab # [ 2.183239] systemd[1]: Finished Create Static Device Nodes in /dev.515gitlab # [ 2.036548] systemd-modules-load[93]: Using 4 probe threads516gitlab # [ 2.184823] systemd[1]: Started Journal Service.517gitlab # [ 2.039272] systemd-modules-load[93]: Inserted module 'virtio_balloon'518gitlab # [ 2.040446] systemd-modules-load[93]: Inserted module 'dm_mod'519gitlab # [ 2.041518] systemd-modules-load[93]: Inserted module 'virtio_gpu'520gitlab # [ 2.043875] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.521gitlab # [ 2.045157] systemd[1]: Finished Load Kernel Module 9pnet_virtio.522gitlab # [ 2.046204] systemd[1]: Finished Apply Kernel Variables.523gitlab # [ 2.049607] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 2.050602] systemd[1]: Reached target Local File Systems.525gitlab # [ 2.051447] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 2.052491] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 2.064913] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 2.077049] systemd-udevd[113]: Using default interface naming scheme 'v261'.529gitlab # [ 2.087883] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.110043] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.110944] systemd[1]: Reached target System Initialization.532gitlab # [ 2.114110] systemd[1]: Reached target Basic System.533gitlab # [ 2.334301] virtio_blk virtio4: 4/0/0 default/read/poll queues534gitlab # [ 2.350254] uhci_hcd 0000:00:01.2: UHCI Host Controller535gitlab # [ 2.351173] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1536gitlab # [ 2.352232] uhci_hcd 0000:00:01.2: detected 2 ports537gitlab # [ 2.353143] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140538gitlab # [ 2.354169] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18539gitlab # [ 2.355377] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1540gitlab # [ 2.356500] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.357251] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd542gitlab # [ 2.358053] usb usb1: SerialNumber: 0000:00:01.2543gitlab # [ 2.362209] hub 1-0:1.0: USB hub found544gitlab # [ 2.363032] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.367847] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12546gitlab # [ 2.370029] serio: i8042 KBD port at 0x60,0x64 irq 1547gitlab # [ 2.370849] serio: i8042 AUX port at 0x60,0x64 irq 12548gitlab # [ 2.371916] SCSI subsystem initialized549gitlab # [ 2.375151] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)550gitlab # [ 2.378656] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.380988] virtio_blk virtio5: [vdb] 11953096 512-byte logical blocks (6.12 GB/5.70 GiB)552gitlab # [ 2.274811] (udev-worker)[140]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.553gitlab # [ 2.277156] (udev-worker)[140]: Network interface NamePolicy= disabled on kernel command line.554gitlab # [ 2.281436] systemd[1]: Starting Virtual Console Setup...555gitlab # [ 2.430743] scsi host0: ata_piix556gitlab # [ 2.286690] (udev-worker)[132]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.435821] scsi host1: ata_piix558gitlab # [ 2.436734] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0559gitlab # [ 2.438001] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0560gitlab # [ 2.440246] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0561gitlab # [ 2.302188] systemd-vconsole-setup[146]: Configuration of first virtual console was skipped, ignoring remaining ones.562gitlab # [ 2.305247] systemd[1]: Finished Virtual Console Setup.563gitlab # [ 2.313867] systemd[1]: Found device /dev/disk/by-label/nixos.564gitlab # [ 2.316874] systemd[1]: Found device /dev/disk/by-label/nix-store.565gitlab # [ 2.317772] systemd[1]: Reached target Initrd Root Device.566gitlab # [ 2.319337] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...567gitlab # [ 2.340859] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks568gitlab # [ 2.343460] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.569gitlab # [ 2.588017] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.596399] ata2: found unknown device (class 0)571gitlab # [ 2.599247] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100572gitlab # [ 2.603386] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5573gitlab # [ 2.659957] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.691382] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.757963] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.761081] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.763830] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.765551] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.767090] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.798061] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.810681] usbcore: registered new interface driver usbhid582gitlab # [ 2.812467] usbhid: USB HID core driver583gitlab # [ 2.821040] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.824392] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.956262] systemd[1]: Mounting /sysroot...586gitlab # [ 3.263483] EXT4-fs (vda): mounted filesystem ab60c868-3ebe-4919-b5a2-75142e7ce4d1 r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.124368] systemd[1]: Mounted /sysroot.588gitlab # [ 3.126552] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.132085] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.135895] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.152859] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.156567] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.162203] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.164467] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.167243] systemd[1]: Mounted /sysroot/nix/.rw-store.596gitlab # [ 3.177294] systemd[1]: Starting rw-sysroot-nix-store.service...597gitlab # [ 3.181784] systemd-sysroot-fstab-check[176]: /sysroot should be mounted in the initrd, will request daemon-reload.598gitlab # [ 3.184602] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.185982] systemd[1]: Reload requested from client PID 176 ('systemd-sysroot') (unit initrd-parse-etc.service)...600gitlab # [ 3.189295] systemd[1]: Reloading...601gitlab # [ 3.339222] erofs (device vdb): mounted with root inode @ nid 128.602gitlab # [ 3.340788] 9p: Installing v9fs 9p2000 file system support603gitlab # [ 3.246343] systemd[1]: Reloading finished in 61 ms.604gitlab # [ 3.275553] systemd-sysroot-fstab-check[176]: Requesting initrd-fs.target/start/replace...605gitlab # [ 3.278479] systemd[1]: Mounted /sysroot/nix/.ro-store.606gitlab # [ 3.280490] systemd[1]: Mounted /sysroot/tmp/shared.607gitlab # [ 3.282452] systemd[1]: Mounted /sysroot/tmp/xchg.608gitlab # [ 3.284355] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.287083] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.289233] systemd-sysroot-fstab-check[176]: Requesting swap.target/start/replace...611gitlab # [ 3.291879] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.294130] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.296512] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.298871] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.306376] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.308942] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.956580] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 4.006435] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 4.008451] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 4.010546] systemd[1]: Starting Find NixOS closure...621gitlab # [ 4.012490] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 4.044851] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 4.047968] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.066369] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.068195] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.070162] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.110115] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.112199] systemd[1]: Stopped target Basic System.629gitlab # [ 4.113931] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.115765] systemd[1]: Stopped target Path Units.631gitlab # [ 4.117375] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.119792] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.122478] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.124670] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.126358] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.128284] systemd[1]: Stopped target Swaps.637gitlab # [ 4.129794] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.131425] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.133556] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.135970] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.138578] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.140477] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.144288] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.146759] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.148957] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.150684] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.153191] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.154649] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.156637] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.158593] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.160450] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.162207] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.163658] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.165423] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.167299] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.168721] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.170656] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.172249] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.173232] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.174303] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.175282] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.176339] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.177160] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.178069] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.179092] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.180140] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.180836] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.181582] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.182669] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.183686] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.184720] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.185682] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.186599] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.204568] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.205654] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.206401] systemd[1]: Reached target Switch Root.677gitlab # [ 4.207345] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.313455] initrd-nixos-activation-start[229]: booting system configuration /nix/store/imxyqan0p5i53x33i4bbv0dikhqkda0x-nixos-system-gitlab-test679gitlab # [ 4.353352] initrd-nixos-activation-start[229]: running activation script...680gitlab # [ 4.616777] initrd-nixos-activation-start[252]: setting up /etc...681gitlab # [ 4.721822] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.724498] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.726349] systemd[1]: Starting Switch Root...684gitlab # [ 4.744135] systemd[1]: Switching root.685gitlab # [ 4.956919] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 5.083009] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.468996] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.479102] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.480943] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.482914] systemd[1]: Detected first boot.691gitlab # [ 5.485453] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.627279] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.716687] systemd[1]: Applying preset policy.694gitlab # [ 5.850887] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.969843] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.971278] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.973873] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.976100] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.977532] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.979045] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.980117] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.981481] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.982596] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.983385] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.984181] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.985080] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.985888] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.986779] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.987657] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.988722] systemd[1]: Reached target Path Units.711gitlab # [ 5.989529] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.990367] systemd[1]: Reached target Slice Units.713gitlab # [ 5.991152] systemd[1]: Reached target Swaps.714gitlab # [ 5.992628] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.994707] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.996186] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.997904] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.998883] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 6.001385] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 6.003008] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 6.005012] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 6.006328] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 6.007538] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 6.008930] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 6.011706] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 6.012925] systemd[1]: Listening on udev Control Socket.727gitlab # [ 6.013839] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 6.017097] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 6.019259] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 6.021367] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 6.024969] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 6.032358] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 6.033394] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 6.037111] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 6.038004] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 6.039620] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 6.043001] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 6.046107] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 6.047470] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 6.068704] systemd[1]: Starting Journal Service...741gitlab # [ 6.072834] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 6.076212] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 6.082909] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 6.084915] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.091124] systemd-journald[322]: Collecting audit messages is enabled.746gitlab # [ 6.091176] systemd[1]: Starting Coldplug All udev Devices...747gitlab # [ 6.100986] systemd[1]: Listening on Journal Log Access Socket.748gitlab # [ 6.102113] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.103827] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.106653] EXT4-fs (vda): re-mounted ab60c868-3ebe-4919-b5a2-75142e7ce4d1.751gitlab # [ 6.106937] systemd[1]: Mounted Kernel Debug File System.752gitlab # [ 6.107101] systemd[1]: Mounted Kernel Trace File System.753gitlab # [ 5.962703] systemd[1]: Queued start job for default target Multi-User System.754gitlab # [ 5.964054] systemd[1]: Unnecessary job was removed for /dev/vdb.755gitlab # [ 5.965286] systemd[1]: systemd-journald.service: Deactivated successfully.[ 6.112129] systemd[1]: Started Journal Service.756gitlab # [ 6.112367] loop: module loaded757gitlab # 758gitlab # [ 5.967849] systemd-modules-load[323]: Using 3 probe threads759gitlab # [ 5.968930] systemd[1]: Finished Create List of Static Device Nodes.760gitlab # [ 5.970076] systemd[1]: modprobe@configfs.service: Deactivated successfully.761gitlab # [ 5.971353] systemd[1]: Finished Load Kernel Module configfs.762gitlab # [ 5.972421] systemd-modules-load[323]: Inserted module 'loop'763gitlab # [ 5.973681] systemd[1]: Mounted FUSE Control File System.764gitlab # [ 5.974795] systemd-modules-load[323]: Inserted module 'tls'765gitlab # [ 5.975768] systemd[1]: Finished Remount Root and Kernel File Systems.766gitlab # [ 5.977053] systemd[1]: Finished Load Kernel Modules.767gitlab # [ 5.977848] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.978875] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 5.980063] systemd[1]: Starting Firewall...770gitlab # [ 5.981371] systemd-oomd[325]: No swap; memory pressure usage will be degraded771gitlab # [ 5.984206] systemd[1]: Starting Flush Journal to Persistent Storage...772gitlab # [ 5.985166] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore773gitlab # [ 5.992252] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 5.996158] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 6.145925] systemd-journald[322]: Received client request to flush runtime journal.776gitlab # [ 6.043373] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...777gitlab # [ 6.045899] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os778gitlab # [ 6.047292] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.779gitlab # [ 6.048842] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 6.050055] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 6.050842] systemd[1]: Reached target First Boot Complete.782gitlab # [ 6.051604] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 6.052357] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 6.053294] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 6.054264] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 6.058838] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 6.059782] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 6.061202] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 6.086362] systemd[1]: Finished Coldplug All udev Devices.790gitlab # [ 6.088649] systemd-udevd[371]: Using default interface naming scheme 'v261'.791gitlab # [ 6.118539] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.182565] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.201522] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 6.214032] (udev-worker)[421]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.795gitlab # [ 6.216375] (udev-worker)[421]: Network interface NamePolicy= disabled on kernel command line.796gitlab # [ 6.220059] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.797gitlab # [ 6.222076] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.236600] systemd[1]: Finished Firewall.799gitlab # [ 6.237776] systemd[1]: Condition check resulted in Virtio network device being skipped.800gitlab # [ 6.238875] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore801gitlab # [ 6.240350] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67802gitlab # [ 6.242601] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore803gitlab # [ 6.244229] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.245501] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os805gitlab # [ 6.446876] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3806gitlab # [ 6.448943] Floppy drive(s): fd0 is 2.88M AMI BIOS807gitlab # [ 6.454016] rtc_cmos 00:05: RTC can wake from S4808gitlab # [ 6.455362] rtc_cmos 00:05: registered as rtc0809gitlab # [ 6.456181] rtc_cmos 00:05: setting system clock to 2026-10-08T16:08:36 UTC (1791475716)810gitlab # [ 6.456571] parport_pc 00:03: reported by Plug and Play ACPI811gitlab # [ 6.457449] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs812gitlab # [ 6.457710] parport0: PC-style at 0x378813gitlab # [ 6.457987] mousedev: PS/2 mouse device common for all mice814gitlab # [ 6.458536] , irq 7815gitlab # [ 6.460882] ACPI: button: Power Button [PWRF]816gitlab # [ 6.462021] [PCSPP(,...)]817gitlab # [ 6.462884] FDC 0 is a S82078B818gitlab # [ 6.469127] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console819gitlab # [ 6.481423] Console: switching to colour dummy device 80x25820gitlab # [ 6.482424] [drm] Found bochs VGA, ID 0xb0c5.821gitlab # [ 6.482427] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.822gitlab # [ 6.482637] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5823gitlab # [ 6.487643] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic824gitlab # [ 6.488530] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0825gitlab # [ 6.494430] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0826gitlab # [ 6.496256] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4827gitlab # [ 6.496266] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD828gitlab # [ 6.504197] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input6829gitlab # [ 6.507545] Console: switching to colour frame buffer device 160x50830gitlab # [ 6.510562] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device831gitlab # [ 6.420423] systemd[1]: Starting Virtual Console Setup...832gitlab # [ 6.446061] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.833gitlab # [ 6.449053] systemd[1]: Stopped Virtual Console Setup.834gitlab # [ 6.464839] systemd[1]: Starting Virtual Console Setup...835gitlab # [ 6.618812] ppdev: user-space parallel port driver836gitlab # [ 6.645540] kvm_amd: TSC scaling supported837gitlab # [ 6.646216] kvm_amd: Nested Virtualization enabled838gitlab # [ 6.646887] kvm_amd: Nested Paging enabled839gitlab # [ 6.647398] kvm_amd: LBR virtualization supported840gitlab # [ 6.648047] kvm_amd: Virtual VMLOAD VMSAVE supported841gitlab # [ 6.648675] kvm_amd: Virtual GIF supported842gitlab # [ 6.649336] kvm_amd: Virtual NMI enabled843gitlab # [ 6.684294] EDAC MC: Ver: 3.0.0844gitlab # [ 6.549099] systemd-vconsole-setup[493]: Configuration of first virtual console was skipped, ignoring remaining ones.845gitlab # [ 6.550880] systemd[1]: Finished Virtual Console Setup.846gitlab # [ 6.827856] systemd[1]: Mounting /run/wrappers...847gitlab # [ 6.845315] systemd[1]: Mounted /run/wrappers.848gitlab # [ 6.846635] systemd[1]: Reached target Local File Systems.849gitlab # [ 6.848246] systemd[1]: Listening on Boot Loader Control Service Socket.850gitlab # [ 6.850618] systemd[1]: Starting register-nix-paths.service...851gitlab # [ 6.852989] systemd[1]: Starting Create SUID/SGID Wrappers...852gitlab # [ 6.854141] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.853gitlab # [ 6.856241] systemd[1]: Starting Save Transient machine-id to Disk...854gitlab # [ 6.859485] systemd[1]: Starting Create System Files and Directories...855gitlab # [ 6.889036] systemd[1]: Finished Create System Files and Directories.856gitlab # [ 6.895716] systemd[1]: Starting Rebuild Journal Catalog...857gitlab # [ 6.899903] systemd[1]: Starting Record System Boot/Shutdown in UTMP...858gitlab # [ 6.911256] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.859gitlab # [ 6.913135] systemd[1]: Finished Save Transient machine-id to Disk.860gitlab # [ 6.918995] systemd[1]: Finished Record System Boot/Shutdown in UTMP.861gitlab # [ 6.933886] systemd[1]: Finished Rebuild Journal Catalog.862gitlab # [ 6.936971] systemd[1]: Starting Update is Completed...863gitlab # [ 6.958398] systemd[1]: Finished Update is Completed.864gitlab # [ 7.010933] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.865gitlab # [ 7.012117] systemd[1]: Finished Create SUID/SGID Wrappers.866gitlab # [ 7.266644] systemd[1]: Finished register-nix-paths.service.867gitlab # [ 7.267848] systemd[1]: Reached target System Initialization.868gitlab # [ 7.268899] systemd[1]: Started Discard unused filesystem blocks once a week.869gitlab # [ 7.270227] systemd[1]: Started logrotate.timer.870gitlab # [ 7.271237] systemd[1]: Started Daily Cleanup of Temporary Directories.871gitlab # [ 7.272404] systemd[1]: Reached target Timer Units.872gitlab # [ 7.273358] systemd[1]: Listening on D-Bus System Message Bus Socket.873gitlab # [ 7.274451] systemd[1]: Listening on Nix Daemon Socket.874gitlab # [ 7.279716] systemd[1]: Starting nixbot CI service socket...875gitlab # [ 7.280772] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.876gitlab # [ 7.285634] systemd[1]: Starting D-Bus System Message Bus...877gitlab # [ 7.286703] systemd[1]: Listening on nixbot CI service socket.878gitlab # [ 7.287711] systemd[1]: Reached target Socket Units.879gitlab # [ 7.345229] dbus-broker-launch[575]: Looking up NSS user entry for 'systemd-timesync'...880gitlab # [ 7.346587] dbus-broker-launch[575]: NSS returned no entry for 'systemd-timesync'881gitlab # [ 7.347842] dbus-broker-launch[575]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"882gitlab # [ 7.352151] systemd[1]: Started D-Bus System Message Bus.883gitlab # [ 7.370085] dbus-broker-launch[575]: Ready884gitlab # [ 7.371775] systemd[1]: Reached target Basic System.885gitlab # [ 7.373990] systemd[1]: Started backdoor.service.886gitlab # [ 7.376068] systemd[1]: Starting gitlab-config.service...887gitlab # [ 7.377943] systemd[1]: Starting Import lastlog data into lastlog2 database...888gitlab # [ 7.381564] systemd[1]: Starting Logrotate configuration check...889gitlab # [ 7.396379] systemd[1]: Starting Name Service Cache Daemon (nsncd)...890gitlab # [ 7.399562] systemd[1]: Starting Post-Boot Actions...891gitlab # [ 7.401802] systemd[1]: Started Reset console on configuration changes.892gitlab # [ 7.405400] systemd[1]: Starting resolvconf update...893gitlab # [ 7.419263] logrotate[580]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.894gitlab # [ 7.422957] logrotate[580]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf895gitlab # connecting to host...896gitlab # [ 7.426748] logrotate[580]: note: 'monthly' overrides previously specified 'weekly'897gitlab # [ 7.428479] logrotate[580]: Reading state from file: /var/lib/logrotate.status898gitlab # [ 7.429622] logrotate[580]: state file /var/lib/logrotate.status does not exist899gitlab # [ 7.430594] logrotate[580]: Allocating hash table for state file, size 64 entries900gitlab # [ 7.431723] logrotate[580]: Handling 4 logs901gitlab # [ 7.432529] logrotate[580]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed902gitlab # [ 7.434671] logrotate[580]: considering log /var/log/btmp903gitlab # [ 7.435515] logrotate[580]: Creating new state904gitlab: Guest shell says: b'Spawning backdoor root shell...\n'905gitlab # [ 7.436218] logrotate[580]: Now: 2026-10-08 16:08906gitlab # [ 7.439142] logrotate[580]: Last rotated at 2026-10-08 16:00907gitlab: connected to guest root shell908gitlab # [ 7.439953] logrotate[580]: log does not need rotating (log has already been rotated)909gitlab: (connecting took 8.11 seconds)910gitlab # [ 7.440952] logrotate[580]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed911gitlab: (finished: waiting for the VM to finish booting, in 8.11 seconds)912gitlab # [ 7.442890] logrotate[580]: considering log /var/log/wtmp913gitlab # [ 7.443678] logrotate[580]: Creating new state914gitlab # [ 7.444284] logrotate[580]: Now: 2026-10-08 16:08915gitlab # [ 7.444920] logrotate[580]: Last rotated at 2026-10-08 16:00916gitlab # [ 7.445741] logrotate[580]: log does not need rotating (log has already been rotated)917gitlab # [ 7.446711] logrotate[580]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed918gitlab # [ 7.448405] logrotate[580]: switching euid from 0 to 165 and egid from 0 to 165 (pid 580)919gitlab # [ 7.449525] logrotate[580]: considering log /var/gitlab/state/log/*.log920gitlab # [ 7.450568] logrotate[580]: log /var/gitlab/state/log/*.log does not exist -- skipping921gitlab # [ 7.451634] logrotate[580]: Creating new state922gitlab # [ 7.452305] logrotate[580]: switching euid from 165 to 0 and egid from 165 to 0 (pid 580)923gitlab # [ 7.453886] logrotate[580]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed924gitlab # [ 7.456170] logrotate[580]: switching euid from 0 to 60 and egid from 0 to 60 (pid 580)925gitlab # [ 7.457304] logrotate[580]: considering log /var/log/nginx/*.log926gitlab # [ 7.458175] logrotate[580]: log /var/log/nginx/*.log does not exist -- skipping927gitlab # [ 7.459223] logrotate[580]: Creating new state928gitlab # [ 7.459925] logrotate[580]: not running postrotate script, since no logs were rotated929gitlab # [ 7.461055] logrotate[580]: switching euid from 60 to 0 and egid from 60 to 0 (pid 580)930gitlab # [ 7.462853] nsncd[581]: Oct 08 16:08:37.633 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"931gitlab # [ 7.465180] systemd[1]: Finished Logrotate configuration check.932gitlab # [ 7.466297] systemd[1]: Finished Post-Boot Actions.933gitlab # [ 7.467218] systemd[1]: Finished Import lastlog data into lastlog2 database.934gitlab # [ 7.469383] systemd[1]: Started Name Service Cache Daemon (nsncd).935gitlab # [ 7.470969] systemd[1]: Reached target Host and Network Name Lookups.936gitlab # [ 7.472060] systemd[1]: Reached target User and Group Name Lookups.937gitlab # [ 7.472929] systemd[1]: Starting User Login Management...938gitlab # [ 7.497289] systemd-logind[611]: New seat seat0.939gitlab # [ 7.497725] systemd[1]: Stopped target Host and Network Name Lookups.940gitlab # [ 7.498416] systemd[1]: Stopping Host and Network Name Lookups...941gitlab # [ 7.498907] systemd[1]: Stopped target User and Group Name Lookups.942gitlab # [ 7.503722] systemd[1]: Stopping User and Group Name Lookups...943gitlab # [ 7.504256] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...944gitlab # [ 7.504718] systemd-logind[611]: Watching system buttons on /dev/input/event2 (Power Button)945gitlab # [ 7.505243] systemd-logind[611]: Watching system buttons on /dev/input/event5 (QEMU Virtio Keyboard)946gitlab # [ 7.505673] systemd-logind[611]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)947gitlab # [ 7.507853] systemd[1]: Started User Login Management.948gitlab # [ 7.508610] systemd[1]: Starting linger-users.service...949gitlab # [ 7.509111] systemd[1]: nscd.service: Deactivated successfully.950gitlab # [ 7.509593] systemd[1]: Stopped Name Service Cache Daemon (nsncd).951gitlab # [ 7.509769] systemd[1]: nscd.service: Consumed 24ms CPU time over 111ms wall clock time, 7.5M memory peak, 5.5M read from disk.952gitlab # [ 7.521567] systemd[1]: Starting Name Service Cache Daemon (nsncd)...953gitlab # [ 7.529183] systemd[1]: linger-users.service: Deactivated successfully.954gitlab # [ 7.529677] systemd[1]: Finished linger-users.service.955gitlab # [ 7.532848] systemd[1]: Finished resolvconf update.956gitlab # [ 7.533551] systemd[1]: Reached target Preparation for Network.957gitlab # [ 7.535828] systemd[1]: Starting DHCP Client...958gitlab # [ 7.537732] systemd[1]: Starting Address configuration of eth1...959gitlab # [ 7.539228] nsncd[680]: Oct 08 16:08:37.729 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"960gitlab # [ 7.541498] systemd[1]: Starting Extra networking commands....961gitlab # [ 7.542887] systemd[1]: Started Name Service Cache Daemon (nsncd).962gitlab # [ 7.544355] systemd[1]: Reached target Host and Network Name Lookups.963gitlab # [ 7.544737] systemd[1]: Reached target User and Group Name Lookups.964gitlab # [ 7.565211] network-addresses-eth1-start[688]: adding address 192.168.1.1/24... done965gitlab # [ 7.567117] network-addresses-eth1-start[688]: adding address 2001:db8:1::1/64... done966gitlab # [ 7.572075] systemd[1]: Finished Address configuration of eth1.967gitlab # [ 7.602032] systemd[1]: Finished Extra networking commands..968gitlab # [ 7.603397] systemd[1]: Reached target Network.969gitlab # [ 7.605230] systemd[1]: Starting gitlab-workhorse.service...970gitlab # [ 7.609886] systemd[1]: Starting Nginx Web Server...971gitlab # [ 7.612179] systemd[1]: Starting PostgreSQL Server...972gitlab # [ 7.613633] dhcpcd[713]: dhcpcd-10.3.2 starting973gitlab # [ 7.614962] systemd[1]: Starting Redis Server - redis-gitlab...974gitlab # [ 7.616727] systemd[1]: Starting Permit User Sessions...975gitlab # [ 7.619414] dhcpcd[766]: dev: loaded udev976gitlab # [ 7.771806] 8021q: 802.1Q VLAN Support v1.8977gitlab # [ 7.772325] 8021q: adding VLAN 0 to HW filter on device eth1978gitlab # [ 7.639140] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.643379] systemd[1]: Finished Permit User Sessions.980gitlab # [ 7.650885] systemd[1]: Started Getty on tty1.981gitlab # [ 7.651230] systemd[1]: Reached target Login Prompts.982gitlab # [ 7.854553] cfg80211: Loading compiled-in X.509 certificates for regulatory database983gitlab # [ 7.859964] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'984gitlab # [ 7.860887] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'985gitlab # [ 7.862439] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2986gitlab # [ 7.863630] cfg80211: failed to load regulatory.db987gitlab # [ 7.738586] nginx-pre-start[788]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok988gitlab # [ 7.738765] nginx-pre-start[788]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful989gitlab # [ 7.744420] systemd[1]: Started Nginx Web Server.990gitlab # [ 7.752721] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.991gitlab # [ 7.753170] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo992gitlab # [ 7.753740] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started993gitlab # [ 7.754531] redis-server[787]: Configuration loaded994gitlab # [ 7.755253] redis[787]: monotonic clock: POSIX clock_gettime995gitlab # [ 7.756117] systemd[1]: Started Redis Server - redis-gitlab.996gitlab # [ 7.756766] redis[787]: Running mode=standalone, port=0.997gitlab # [ 7.757793] redis[787]: Server initialized998gitlab # [ 7.758631] redis[787]: Ready to accept connections unix999gitlab # [ 7.759646] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1000gitlab # [ 7.765096] postgresql-pre-start[790]: The files belonging to this database system will be owned by user "postgres".1001gitlab # [ 7.765441] postgresql-pre-start[790]: This user must also own the server process.1002gitlab # [ 7.917210] 8021q: adding VLAN 0 to HW filter on device eth01003gitlab # [ 7.770764] postgresql-pre-start[790]: The database cluster will be initialized with locale "en_US.UTF-8".1004gitlab # [ 7.772656] postgresql-pre-start[790]: The default database encoding has accordingly been set to "UTF8".1005gitlab # [ 7.774129] postgresql-pre-start[790]: The default text search configuration will be set to "english".1006gitlab # [ 7.775282] postgresql-pre-start[790]: Data page checksums are enabled.1007gitlab # [ 7.775907] postgresql-pre-start[790]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1008gitlab # [ 7.776581] dhcpcd[766]: eth0: waiting for carrier1009gitlab # [ 7.777141] postgresql-pre-start[790]: creating subdirectories ... ok1010gitlab # [ 7.777514] postgresql-pre-start[790]: selecting dynamic shared memory implementation ... posix1011gitlab # [ 7.778262] dhcpcd[766]: eth0: carrier acquired1012gitlab # [ 7.781757] dhcpcd[766]: DUID 00:01:00:01:32:5a:7c:85:52:54:00:12:34:561013gitlab # [ 7.782184] dhcpcd[766]: eth0: IAID 00:12:34:561014gitlab # [ 7.782895] dhcpcd[766]: eth0: adding address fe80::5054:ff:fe12:34561015gitlab # [ 7.814121] postgresql-pre-start[790]: selecting default "max_connections" ... 1001016gitlab # [ 7.849279] postgresql-pre-start[790]: selecting default "shared_buffers" ... 128MB1017gitlab # [ 8.131274] systemd[1]: Started gitlab-workhorse.service.1018gitlab # [ 8.263631] postgresql-pre-start[790]: selecting default time zone ... UTC1019gitlab # [ 8.265134] postgresql-pre-start[790]: creating configuration files ... ok1020gitlab # [ 8.334450] gitlab-workhorse[822]: time="2026-10-08T16:08:38Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41021gitlab # [ 8.335445] gitlab-workhorse[822]: time="2026-10-08T16:08:38Z" level=info msg="Using redis/go-redis"1022gitlab # [ 8.336603] gitlab-workhorse[822]: time="2026-10-08T16:08:38Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1023gitlab # [ 8.431834] postgresql-pre-start[790]: running bootstrap script ... ok1024gitlab # [ 8.849760] postgresql-pre-start[790]: performing post-bootstrap initialization ... ok1025gitlab # [ 9.129692] postgresql-pre-start[790]: syncing data to disk ... ok1026gitlab # [ 9.130520] postgresql-pre-start[790]: initdb: warning: enabling "trust" authentication for local connections1027gitlab # [ 9.131102] postgresql-pre-start[790]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1028gitlab # [ 9.132052] postgresql-pre-start[790]: Success. You can now start the database server using:1029gitlab # [ 9.132681] postgresql-pre-start[790]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1030gitlab # [ 9.242180] postgres[848]: [848] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1031gitlab # [ 9.242771] postgres[848]: [848] LOG: listening on IPv6 address "::1", port 54321032gitlab # [ 9.243788] postgres[848]: [848] LOG: listening on IPv4 address "127.0.0.1", port 54321033gitlab # [ 9.247128] postgres[848]: [848] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1034gitlab # [ 9.259688] postgres[857]: [857] LOG: database system was shut down at 2026-10-08 16:08:39 GMT1035gitlab # [ 9.266097] postgres[848]: [848] LOG: database system is ready to accept connections1036gitlab # [ 9.272888] systemd[1]: Started PostgreSQL Server.1037gitlab # [ 9.273542] systemd[1]: Starting PostgreSQL Setup Scripts...1038gitlab # [ 9.405723] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[865]: mkdir -p /var/gitlab/state/home/.ssh: OK1039gitlab # [ 9.408264] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[865]: chmod 700 /var/gitlab/state/home/.ssh: OK1040gitlab # [ 9.432267] postgresql-setup-start[873]: CREATE DATABASE1041gitlab # [ 9.457296] dhcpcd[766]: eth0: soliciting an IPv6 router1042gitlab # [ 9.458785] systemd[1]: Finished gitlab-config.service.1043gitlab # [ 9.459780] dhcpcd[766]: eth0: Router Advertisement from fe80::21044gitlab # [ 9.460787] dhcpcd[766]: eth0: adding address fec0::5054:ff:fe12:3456/641045gitlab # [ 9.461738] dhcpcd[766]: eth0: adding route to fec0::/641046gitlab # [ 9.462513] systemd[1]: Started gitaly.service.1047gitlab # [ 9.463424] postgresql-setup-start[889]: CREATE ROLE1048gitlab # [ 9.464171] dhcpcd[766]: eth0: adding default route via fe80::21049gitlab # [ 9.472669] postgresql-setup-start[893]: ALTER DATABASE1050gitlab # [ 9.490537] postgresql-setup-start[899]: CREATE ROLE1051gitlab # [ 9.493266] systemd[1]: Finished PostgreSQL Setup Scripts.1052gitlab # [ 9.494147] systemd[1]: Reached target PostgreSQL.1053gitlab # [ 9.495937] systemd[1]: Starting gitlab-db-config.service...1054gitlab # [ 9.496757] systemd[1]: Starting gitlab-postgresql.service...1055gitlab # [ 9.589253] gitlab-postgresql-start[909]: CREATE DATABASE1056gitlab # [ 9.618943] gitlab-postgresql-start[923]: CREATE EXTENSION1057gitlab # [ 9.696931] gitlab-postgresql-start[925]: CREATE EXTENSION1058gitlab # [ 9.700184] systemd[1]: Finished gitlab-postgresql.service.1059gitlab # [ 9.778538] dhcpcd[766]: eth0: soliciting a DHCP lease1060gitlab # [ 9.932588] NET: Registered PF_PACKET protocol family1061gitlab # [ 9.796911] dhcpcd[766]: eth0: offered 10.0.2.15 from 10.0.2.21062gitlab # [ 9.800226] dhcpcd[766]: eth0: probing address 10.0.2.15/241063gitlab # [ 9.970315] gitaly[892]: time="2026-10-08T16:08:40.159Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=8921064gitlab # [ 9.970983] gitaly[892]: time="2026-10-08T16:08:40.160Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=8921065gitlab # [ 9.971723] gitaly[892]: time="2026-10-08T16:08:40.160Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=8921066gitlab # [ 9.975092] gitaly[892]: time="2026-10-08T16:08:40.160Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=8921067gitlab # [ 9.975649] gitaly[892]: time="2026-10-08T16:08:40.160Z" level=info msg="Starting Gitaly" pid=892 version=1068gitlab # [ 10.129414] gitaly[892]: time="2026-10-08T16:08:40.319Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=158 pid=8921069gitlab # [ 10.129759] gitaly[892]: time="2026-10-08T16:08:40.319Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=8921070gitlab # [ 10.130868] gitaly[892]: time="2026-10-08T16:08:40.321Z" level=info msg="finished initializing command factory" duration_ms=0 pid=8921071gitlab # [ 10.132172] gitaly[892]: time="2026-10-08T16:08:40.322Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-892/git-exec-125162990.d/git pid=8921072gitlab # [ 10.141066] gitaly[892]: time="2026-10-08T16:08:40.331Z" level=info msg="finished detecting git version" duration_ms=9 pid=8921073gitlab # [ 10.142125] gitaly[892]: time="2026-10-08T16:08:40.332Z" level=info msg="using Git version" pid=892 version=2.53.g1074gitlab # [ 10.142971] gitaly[892]: time="2026-10-08T16:08:40.333Z" level=info msg="clearing disk cache object folder" pid=892 storage=default1075gitlab # [ 10.144136] gitaly[892]: time="2026-10-08T16:08:40.334Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2474923677 pid=892 storage=default1076gitlab # [ 10.145292] gitaly[892]: time="2026-10-08T16:08:40.334Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2474923677 pid=892 storage=default1077gitlab # [ 10.146259] gitaly[892]: time="2026-10-08T16:08:40.334Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=8921078gitlab # [ 10.147295] gitaly[892]: time="2026-10-08T16:08:40.334Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=8921079gitlab # [ 10.148197] gitaly[892]: time="2026-10-08T16:08:40.335Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2474923677 clear_duration_ms=0 pid=892 storage=default1080gitlab # [ 10.191394] gitaly[892]: time="2026-10-08T16:08:40.381Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=8921081gitlab # [ 10.191816] gitaly[892]: time="2026-10-08T16:08:40.381Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=892 schema=unix1082gitlab # [ 10.192444] gitaly[892]: time="2026-10-08T16:08:40.382Z" level=info msg="listening at address" address=/run/gitaly/gitaly-892/sock.d/intern pid=892 schema=unix1083gitlab # [ 10.192873] gitaly[892]: time="2026-10-08T16:08:40.382Z" level=info msg="finished tempdir cleaner walk" pid=892 storage=default time_ms=01084gitlab # [ 10.193494] gitaly[892]: time="2026-10-08T16:08:40.381Z" level=info msg="counting repositories" pid=8921085gitlab # [ 10.193946] gitaly[892]: time="2026-10-08T16:08:40.382Z" level=info msg="starting to count repositories" pid=892 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.202069] gitaly[892]: time="2026-10-08T16:08:40.392Z" level=info msg="completed counting repositories" counting_duration_ms=10 pid=892 storage_path=/var/gitlab/state/repositories1087gitlab # [ 10.202359] gitaly[892]: time="2026-10-08T16:08:40.392Z" level=info msg="completed counting all repositories" counting_duration=10 pid=8921088gitlab # [ 10.207099] gitaly[892]: time="2026-10-08T16:08:40.397Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=8921089gitlab # [ 10.208088] gitaly[892]: time="2026-10-08T16:08:40.397Z" level=info msg="Started Gitaly" duration_ms=237 pid=8921090gitlab # [ 10.208970] gitaly[892]: time="2026-10-08T16:08:40.397Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=8921091gitlab # [ 10.210033] gitaly[892]: time="2026-10-08T16:08:40.398Z" level=info msg="maintenance: daily scheduled" pid=892 scheduled="2026-10-09 12:00:00 +0000 UTC"1092gitlab # [ 11.018171] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1093gitlab # [ 11.019142] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1094gitlab # [ 11.057888] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1095gitlab # [ 12.104129] gitaly[892]: time="2026-10-08T16:08:42.293Z" level=info msg="License database preloaded" duration_ms=2133 pid=8921096gitlab # [ 14.873975] dhcpcd[766]: eth0: leased 10.0.2.15 for 86400 seconds1097gitlab # [ 14.876624] dhcpcd[766]: eth0: adding route to 10.0.2.0/241098gitlab # [ 14.878931] dhcpcd[766]: eth0: adding default route via 10.0.2.21099gitlab # [ 14.999183] systemd[1]: Started DHCP Client.1100gitlab # [ 15.001300] systemd[1]: Reached target Network is Online.1101gitlab # [ 40.843924] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[904]: W, [2026-10-08T16:09:11.033626 #904] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1102gitlab # [ 42.965084] postgres[1306]: [1306] ERROR: relation "feature_gates" does not exist at character 5231103gitlab # [ 42.965497] postgres[1306]: [1306] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1104gitlab # [ 42.965844] postgres[1306]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1105gitlab # [ 42.968905] postgres[1306]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1106gitlab # [ 42.971203] postgres[1306]: attidentity AS identity,1107gitlab # [ 42.973457] postgres[1306]: attgenerated as attgenerated1108gitlab # [ 42.976159] postgres[1306]: FROM pg_attribute a1109gitlab # [ 42.978477] postgres[1306]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1110gitlab # [ 42.980197] postgres[1306]: LEFT JOIN pg_type t ON a.atttypid = t.oid1111gitlab # [ 42.982375] postgres[1306]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1112gitlab # [ 42.984545] postgres[1306]: WHERE a.attrelid = '"feature_gates"'::regclass1113gitlab # [ 42.987231] postgres[1306]: AND a.attnum > 0 AND NOT a.attisdropped1114gitlab # [ 42.989479] postgres[1306]: ORDER BY a.attnum1115gitlab # [ 42.990826] postgres[1306]:1116gitlab # [ 46.330942] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1339]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1117gitlab # [ 46.336647] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1339]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1118gitlab # [ 48.384791] gitlab-workhorse[822]: time="2026-10-08T16:09:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 58.385947] gitlab-workhorse[822]: time="2026-10-08T16:09:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1120gitlab # [ 61.026554] postgres[1414]: [1414] ERROR: relation "table_without_models" does not exist1121gitlab # [ 61.026878] postgres[1414]: [1414] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1122gitlab # [ 68.386400] gitlab-workhorse[822]: time="2026-10-08T16:09:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1123gitlab # [ 72.762169] systemd[1]: Finished gitlab-db-config.service.1124gitlab # [ 72.768603] systemd[1]: Started gitlab-sidekiq.service.1125gitlab # [ 72.773316] systemd[1]: Starting gitlab.service...1126gitlab # [ 73.108263] bundle[1581]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1127gitlab # [ 73.108835] bundle[1581]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1128gitlab # [ 73.109918] bundle[1581]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1129gitlab # [ 75.807222] sidekiq-cluster[1580]: {"severity":"INFO","time":"2026-10-08T16:09:45.980Z","message":"Starting cluster with 1 processes"}1130gitlab # [ 75.830676] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.002Z","pid":1581,"message":"* Enabling systemd notification integration"}1131gitlab # [ 75.831377] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"Puma starting in cluster mode..."}1132gitlab # [ 75.832210] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1133gitlab # [ 75.832950] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1134gitlab # [ 75.833731] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Min threads: 0"}1135gitlab # [ 75.834598] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Max threads: 4"}1136gitlab # [ 75.835298] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Environment: production"}1137gitlab # [ 75.835976] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Master PID: 1581"}1138gitlab # [ 75.836616] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Workers: 2"}1139gitlab # [ 75.837458] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1140gitlab # [ 75.838173] bundle[1581]: {"timestamp":"2026-10-08T16:09:46.020Z","pid":1581,"message":"* Preloading application"}1141gitlab # [ 78.397292] gitlab-workhorse[822]: time="2026-10-08T16:09:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 88.398531] gitlab-workhorse[822]: time="2026-10-08T16:09:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 97.746381] bundle[1581]: W, [2026-10-08T16:10:07.935867 #1581] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 98.399651] gitlab-workhorse[822]: time="2026-10-08T16:10:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 99.974648] sidekiq-cluster[1611]: 2026-10-08T16:10:10.164Z pid=1611 tid=wkj INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1611, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434024448}1146gitlab # [ 100.143217] sidekiq-cluster[1611]: W, [2026-10-08T16:10:10.333458 #1611] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 100.181513] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:10.371Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1148gitlab # [ 101.981553] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.171Z","message":"GitLab reliable fetch activated!"}1149gitlab # [ 101.982106] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.171Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1150gitlab # [ 102.001492] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.191Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1151gitlab # [ 102.003283] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.193Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1152gitlab # [ 102.005135] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.195Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1153gitlab # [ 102.006932] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.197Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1154gitlab # [ 102.008838] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.199Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1155gitlab # [ 102.010690] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.201Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1156gitlab # [ 102.012123] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.202Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1157gitlab # [ 102.013487] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.203Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1158gitlab # [ 102.014850] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.205Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1159gitlab # [ 102.016303] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.206Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1160gitlab # [ 102.017657] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.208Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1161gitlab # [ 102.019526] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.209Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1162gitlab # [ 102.020925] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.211Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1163gitlab # [ 102.022389] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.212Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1164gitlab # [ 102.023973] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.214Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1165gitlab # [ 102.025704] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.216Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1166gitlab # [ 102.027792] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.218Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1167gitlab # [ 102.029848] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.220Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1168gitlab # [ 102.031802] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.222Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1169gitlab # [ 102.033815] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.224Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1170gitlab # [ 102.035858] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.226Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1171gitlab # [ 102.037674] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.228Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1172gitlab # [ 102.039119] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.229Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1173gitlab # [ 102.041130] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.231Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1174gitlab # [ 102.043092] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.233Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1175gitlab # [ 102.045114] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.235Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1176gitlab # [ 102.047167] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.237Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1177gitlab # [ 102.049192] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.239Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1178gitlab # [ 102.051099] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.241Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1179gitlab # [ 102.053094] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.243Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1180gitlab # [ 102.054927] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.245Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1181gitlab # [ 102.057047] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.247Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1182gitlab # [ 102.058922] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.249Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1183gitlab # [ 102.060442] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.250Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1184gitlab # [ 102.062361] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.252Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1185gitlab # [ 102.064123] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.254Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1186gitlab # [ 102.065878] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.256Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1187gitlab # [ 102.068058] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.258Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1188gitlab # [ 102.069509] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.259Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1189gitlab # [ 102.071174] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.261Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1190gitlab # [ 102.072941] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.263Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1191gitlab # [ 102.074389] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.264Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1192gitlab # [ 102.076120] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.266Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1193gitlab # [ 102.078093] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.268Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1194gitlab # [ 102.080190] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.270Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1195gitlab # [ 102.081850] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.272Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1196gitlab # [ 102.083410] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.273Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1197gitlab # [ 102.085155] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.275Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1198gitlab # [ 102.086888] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.277Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1199gitlab # [ 102.088844] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.279Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1200gitlab # [ 102.090727] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.281Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1201gitlab # [ 102.092710] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.283Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1202gitlab # [ 102.101163] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.291Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1203gitlab # [ 102.103672] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.294Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1204gitlab # [ 102.105607] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.296Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1205gitlab # [ 102.107782] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.298Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1206gitlab # [ 102.109658] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.300Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1207gitlab # [ 102.111835] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.302Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1208gitlab # [ 102.113535] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.303Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1209gitlab # [ 102.114959] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.305Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1210gitlab # [ 102.116794] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.307Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1211gitlab # [ 102.118164] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.308Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1212gitlab # [ 102.120303] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.310Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1213gitlab # [ 102.122618] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.313Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1214gitlab # [ 102.124420] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.314Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1215gitlab # [ 102.156110] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.345Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1216gitlab # [ 102.158505] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.348Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1217gitlab # [ 102.159560] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.350Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1218gitlab # [ 102.161753] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.352Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1219gitlab # [ 102.164043] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.354Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1220gitlab # [ 102.166705] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.357Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1221gitlab # [ 102.168434] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.358Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1222gitlab # [ 102.170894] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.361Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1223gitlab # [ 102.172486] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.362Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1224gitlab # [ 102.174972] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.365Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1225gitlab # [ 102.177052] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.367Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1226gitlab # [ 102.179202] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.369Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1227gitlab # [ 102.181656] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.372Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1228gitlab # [ 102.183904] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.374Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1229gitlab # [ 102.186324] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.376Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1230gitlab # [ 102.187840] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.378Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1231gitlab # [ 102.190117] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.380Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1232gitlab # [ 102.192932] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.383Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1233gitlab # [ 102.195331] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.385Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1234gitlab # [ 102.197105] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.387Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1235gitlab # [ 102.198965] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.389Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1236gitlab # [ 102.201620] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.392Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1237gitlab # [ 102.203225] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.393Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1238gitlab # [ 102.205586] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.396Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1239gitlab # [ 102.207747] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.398Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1240gitlab # [ 102.210053] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.400Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1241gitlab # [ 102.211862] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.402Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1242gitlab # [ 102.214099] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.404Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1243gitlab # [ 102.216151] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.406Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1244gitlab # [ 102.218844] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.409Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1245gitlab # [ 102.220904] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.411Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1246gitlab # [ 102.223165] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.413Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1247gitlab # [ 102.224851] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.415Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1248gitlab # [ 102.234219] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.424Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1249gitlab # [ 102.235680] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.426Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1250gitlab # [ 102.237897] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.428Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1251gitlab # [ 102.241100] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.431Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1252gitlab # [ 102.243657] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.434Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1253gitlab # [ 102.245657] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.436Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1254gitlab # [ 102.248296] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.438Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1255gitlab # [ 102.249806] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.440Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1256gitlab # [ 102.252185] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.442Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1257gitlab # [ 102.254718] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.445Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1258gitlab # [ 102.256618] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:12.447Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1259gitlab # [ 105.551878] sidekiq-cluster[1611]: InitializerConnections Query: SET client_min_messages TO 'warning'1260gitlab # [ 105.552207] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1261gitlab # [ 105.552659] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1262gitlab # [ 105.553598] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1263gitlab # [ 105.554749] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1264gitlab # [ 105.555918] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1265gitlab # [ 105.557086] sidekiq-cluster[1611]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1266gitlab # [ 105.575679] sidekiq-cluster[1611]: InitializerConnections Query: SET standard_conforming_strings = on1267gitlab # [ 105.575798] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1268gitlab # [ 105.576409] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1269gitlab # [ 105.576908] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1270gitlab # [ 105.577548] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1271gitlab # [ 105.578043] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1272gitlab # [ 105.578525] sidekiq-cluster[1611]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1273gitlab # [ 105.598621] sidekiq-cluster[1611]: InitializerConnections Query: SET intervalstyle = iso_86011274gitlab # [ 105.598769] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1275gitlab # [ 105.599386] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1276gitlab # [ 105.599877] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1277gitlab # [ 105.600335] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1278gitlab # [ 105.600880] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1279gitlab # [ 105.601515] sidekiq-cluster[1611]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1280gitlab # [ 105.621060] sidekiq-cluster[1611]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1281gitlab # [ 105.621200] sidekiq-cluster[1611]: FROM pg_type as t1282gitlab # [ 105.621679] sidekiq-cluster[1611]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1283gitlab # [ 105.622396] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1284gitlab # [ 105.622906] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1285gitlab # [ 105.623508] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1286gitlab # [ 105.624046] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1287gitlab # [ 105.624474] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1288gitlab # [ 105.624966] sidekiq-cluster[1611]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1289gitlab # [ 105.641883] sidekiq-cluster[1611]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1290gitlab # [ 105.642590] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1291gitlab # [ 105.645149] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1292gitlab # [ 105.646429] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1293gitlab # [ 105.647776] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1294gitlab # [ 105.649196] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1295gitlab # [ 105.649730] sidekiq-cluster[1611]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1296gitlab # [ 105.651932] sidekiq-cluster[1611]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'per_thread_db_connection_pool_metrics'1297gitlab # [ 105.652705] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1298gitlab # [ 105.653510] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1299gitlab # [ 105.654250] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1300gitlab # [ 105.654913] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1301gitlab # [ 105.655721] sidekiq-cluster[1611]: InitializerConnections Backtrace: lib/gitlab/daemon.rb:58:in `block (2 levels) in start'1302gitlab # [ 105.656453] sidekiq-cluster[1611]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1303gitlab # [ 108.408825] gitlab-workhorse[822]: time="2026-10-08T16:10:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1304gitlab # [ 118.418852] gitlab-workhorse[822]: time="2026-10-08T16:10:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1305gitlab # [ 125.992409] postgres[2040]: [2040] ERROR: relation "table_without_models" does not exist1306gitlab # [ 125.992790] postgres[2040]: [2040] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1307gitlab # [ 127.661100] postgres[2051]: [2051] ERROR: relation "table_without_models" does not exist1308gitlab # [ 127.663930] postgres[2051]: [2051] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1309gitlab # [ 128.420436] gitlab-workhorse[822]: time="2026-10-08T16:10:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1310gitlab # [ 128.494868] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:38.684Z","message":"Booted Rails 7.2.3.1 application in production environment"}1311gitlab # [ 128.500199] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:38.689Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1312gitlab # [ 128.505113] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:38.689Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1313gitlab # [ 128.509315] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:38.689Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1314gitlab # [ 128.513979] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:38.691Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1315gitlab # [ 129.760866] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:39.950Z","message":"Cleaning working queues"}1316gitlab # [ 129.763142] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:39.953Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"44f7bd902e3c3bc79267ae2d","created_at":"2026-10-08T16:09:42.572Z","trace_propagation_headers":{"sentry-trace":"7f3197283e604d7c9b8fb3c4e4a94f7f-34c5344c15484091","baggage":"sentry-trace_id=7f3197283e604d7c9b8fb3c4e4a94f7f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f3862989152621769007561aa38f2a20","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-08T16:09:42.579Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-44f7bd902e3c3bc79267ae2d: start","job_status":"start","queue_duration_s":57.373667,"scheduling_latency_s":57.373711}1317gitlab # [ 129.897776] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:10:40.087Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"44f7bd902e3c3bc79267ae2d","created_at":"2026-10-08T16:09:42.572Z","trace_propagation_headers":{"sentry-trace":"7f3197283e604d7c9b8fb3c4e4a94f7f-34c5344c15484091","baggage":"sentry-trace_id=7f3197283e604d7c9b8fb3c4e4a94f7f,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f3862989152621769007561aa38f2a20","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-08T16:09:42.579Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-44f7bd902e3c3bc79267ae2d: done: 0.134563 sec","job_status":"done","queue_duration_s":57.373667,"scheduling_latency_s":57.373711,"redis_calls":29,"redis_duration_s":0.004113,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.002433,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00068,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.079037978,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.134563,"completed_at":"2026-10-08T16:10:40.087Z","load_balancing_strategy":"primary","db_duration_s":0.051826,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1318gitlab # [ 130.400387] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.590Z","pid":1581,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1319gitlab # [ 130.404667] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.590Z","pid":1581,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1320gitlab # [ 130.408508] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.590Z","pid":1581,"message":"! #\u003cThread:0x00007f3a1b90f8d8 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1321gitlab # [ 130.419797] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.590Z","pid":1581,"message":"! #\u003cThread:0x00007f3a1bb94a18 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1322gitlab # [ 130.431125] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.590Z","pid":1581,"message":"Use Ctrl-C to stop"}1323gitlab # [ 130.434190] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.590Z","pid":1581,"message":"Sending status to systemd every 1.0 sec"}1324gitlab # [ 130.706423] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.896Z","pid":1581,"message":"- Worker 1 (PID: 2157) booted in 0.26s, phase: 0"}1325gitlab # [ 130.712747] bundle[1581]: {"timestamp":"2026-10-08T16:10:40.903Z","pid":1581,"message":"- Worker 0 (PID: 2153) booted in 0.28s, phase: 0"}1326gitlab # [ 130.717067] systemd[1]: Started gitlab.service.1327gitlab # [ 130.718875] systemd[1]: Reached target Common target for all GitLab services..1328gitlab # [ 130.721400] systemd[1]: Starting setup-gitlab.service...1329gitlab # [ 130.744816] setup-gitlab-start[2181]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1330gitlab # [ 133.031427] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:10:43 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 22551331gitlab # [ 133.036615] setup-gitlab-start[2181]: + TOKEN=nixbot-test-token-of-20-chars1332gitlab # [ 133.039096] setup-gitlab-start[2181]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1333gitlab # [ 133.051401] runuser[2199]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1334gitlab # [ 133.430186] setup-gitlab-start[2200]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1335gitlab # [ 133.435179] setup-gitlab-start[2200]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1336gitlab # [ 133.439939] setup-gitlab-start[2200]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1337gitlab # [ 133.994304] setup-gitlab-start[2200]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1338gitlab # [ 133.995210] setup-gitlab-start[2200]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1339gitlab # [ 133.996219] setup-gitlab-start[2200]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1340gitlab # [ 152.119397] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:02.308Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3c2bd994dc2df2dab1e411e0","created_at":"2026-10-08T16:11:02.273Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f76baaa7366a9066524dde5200d56ec","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.306Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3c2bd994dc2df2dab1e411e0: start","job_status":"start","queue_duration_s":0.002276,"scheduling_latency_s":0.002369}1341gitlab # [ 152.693506] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:02.883Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3c2bd994dc2df2dab1e411e0","created_at":"2026-10-08T16:11:02.273Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4f76baaa7366a9066524dde5200d56ec","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.306Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3c2bd994dc2df2dab1e411e0: done: 0.574919 sec","job_status":"done","queue_duration_s":0.002276,"scheduling_latency_s":0.002369,"redis_calls":565,"redis_duration_s":0.329565,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.327453,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.281451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252825,"duration_s":0.574919,"completed_at":"2026-10-08T16:11:02.883Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00077,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 152.732313] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:02.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"102d616bc418ed231d9f39cb","created_at":"2026-10-08T16:11:02.343Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.378Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-102d616bc418ed231d9f39cb: start","job_status":"start","queue_duration_s":0.544206,"scheduling_latency_s":0.544227}1343gitlab # [ 152.841089] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"102d616bc418ed231d9f39cb","created_at":"2026-10-08T16:11:02.343Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.378Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-102d616bc418ed231d9f39cb: done: 0.108677 sec","job_status":"done","queue_duration_s":0.544206,"scheduling_latency_s":0.544227,"redis_calls":71,"redis_duration_s":0.018130999999999998,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003239,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001021,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012672,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000336355,"duration_s":0.108677,"completed_at":"2026-10-08T16:11:03.031Z","load_balancing_strategy":"primary","db_duration_s":0.001876,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 152.910141] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4996e3c0c95a9ff0f7fbc243","created_at":"2026-10-08T16:11:02.413Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9640065cc2ae3e3814e79b71ded283c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-08T16:11:02.423Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4996e3c0c95a9ff0f7fbc243: start","job_status":"start","queue_duration_s":0.676722,"scheduling_latency_s":0.676751}1345gitlab # [ 152.931820] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.121Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1346gitlab # [ 152.943680] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4996e3c0c95a9ff0f7fbc243","created_at":"2026-10-08T16:11:02.413Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9640065cc2ae3e3814e79b71ded283c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-08T16:11:02.423Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4996e3c0c95a9ff0f7fbc243: done: 0.03333 sec","job_status":"done","queue_duration_s":0.676722,"scheduling_latency_s":0.676751,"redis_calls":10,"redis_duration_s":0.0047940000000000005,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000336914,"duration_s":0.03333,"completed_at":"2026-10-08T16:11:03.133Z","load_balancing_strategy":"primary","db_duration_s":0.00064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 152.981420] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.171Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f8a3321d4e7b225cada00da9","created_at":"2026-10-08T16:11:02.445Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23a8e8263133993bea38aed61fe7aa50","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.453Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f8a3321d4e7b225cada00da9: start","job_status":"start","queue_duration_s":0.71843,"scheduling_latency_s":0.718463}1348gitlab # [ 153.020897] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"f8a3321d4e7b225cada00da9","created_at":"2026-10-08T16:11:02.445Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"23a8e8263133993bea38aed61fe7aa50","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.453Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-f8a3321d4e7b225cada00da9: done: 0.039376 sec","job_status":"done","queue_duration_s":0.71843,"scheduling_latency_s":0.718463,"redis_calls":12,"redis_duration_s":0.002162,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000705,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000371,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000362616,"duration_s":0.039376,"completed_at":"2026-10-08T16:11:03.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 153.022679] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2da61e46294aad5aaa2db079","created_at":"2026-10-08T16:11:02.461Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd5ba3c94af12148aa0d5c3ef3f66fb3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.468Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2da61e46294aad5aaa2db079: start","job_status":"start","queue_duration_s":0.744382,"scheduling_latency_s":0.744419}1350gitlab # [ 153.093902] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2da61e46294aad5aaa2db079","created_at":"2026-10-08T16:11:02.461Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dd5ba3c94af12148aa0d5c3ef3f66fb3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.468Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2da61e46294aad5aaa2db079: done: 0.070914 sec","job_status":"done","queue_duration_s":0.744382,"scheduling_latency_s":0.744419,"redis_calls":12,"redis_duration_s":0.003453,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000587,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000740596,"exclusive_lock_hold_duration_s":0.036288969000000004,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.070914,"completed_at":"2026-10-08T16:11:03.283Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 153.095250] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e108dc4a17598fa068df1562","created_at":"2026-10-08T16:11:02.480Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09525bd7770613f374d69106fee227d0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.488Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e108dc4a17598fa068df1562: start","job_status":"start","queue_duration_s":0.797093,"scheduling_latency_s":0.797107}1352gitlab # [ 153.134498] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.309Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e108dc4a17598fa068df1562","created_at":"2026-10-08T16:11:02.480Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09525bd7770613f374d69106fee227d0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.488Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e108dc4a17598fa068df1562: done: 0.023945 sec","job_status":"done","queue_duration_s":0.797093,"scheduling_latency_s":0.797107,"redis_calls":16,"redis_duration_s":0.003606,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001904,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000472,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000258692,"duration_s":0.023945,"completed_at":"2026-10-08T16:11:03.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004925,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 153.142951] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"539fd0364f86ec5480a51e90","created_at":"2026-10-08T16:11:02.498Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6a54e4a0c727703d86254d6afcdcc92","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.504Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-539fd0364f86ec5480a51e90: start","job_status":"start","queue_duration_s":0.805241,"scheduling_latency_s":0.805255}1354gitlab # [ 153.277505] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"539fd0364f86ec5480a51e90","created_at":"2026-10-08T16:11:02.498Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6a54e4a0c727703d86254d6afcdcc92","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.504Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-539fd0364f86ec5480a51e90: done: 0.157002 sec","job_status":"done","queue_duration_s":0.805241,"scheduling_latency_s":0.805255,"redis_calls":14,"redis_duration_s":0.00279,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000802,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000389994,"exclusive_lock_hold_duration_s":0.140318671,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.157002,"completed_at":"2026-10-08T16:11:03.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 153.328203] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.518Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"efed899493b64abf22825c9d","created_at":"2026-10-08T16:11:02.565Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb343ee9b649963c55bf97639f0a0079","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.574Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-efed899493b64abf22825c9d: start","job_status":"start","queue_duration_s":0.94432,"scheduling_latency_s":0.944349}1356gitlab # [ 153.350972] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"efed899493b64abf22825c9d","created_at":"2026-10-08T16:11:02.565Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb343ee9b649963c55bf97639f0a0079","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.574Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-efed899493b64abf22825c9d: done: 0.022899 sec","job_status":"done","queue_duration_s":0.94432,"scheduling_latency_s":0.944349,"redis_calls":10,"redis_duration_s":0.002168,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001248,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000279644,"duration_s":0.022899,"completed_at":"2026-10-08T16:11:03.541Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 153.389355] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"35ce7bafa5bd63153ba15bd7","created_at":"2026-10-08T16:11:02.582Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f886cbb94debee49dbbc95793bedec6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-08T16:11:02.589Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-35ce7bafa5bd63153ba15bd7: start","job_status":"start","queue_duration_s":0.990116,"scheduling_latency_s":0.99014}1358gitlab # [ 153.416622] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.606Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1359gitlab # [ 153.426504] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"35ce7bafa5bd63153ba15bd7","created_at":"2026-10-08T16:11:02.582Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f886cbb94debee49dbbc95793bedec6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-08T16:11:02.589Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-35ce7bafa5bd63153ba15bd7: done: 0.03706 sec","job_status":"done","queue_duration_s":0.990116,"scheduling_latency_s":0.99014,"redis_calls":10,"redis_duration_s":0.003183,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00071,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000528,"duration_s":0.03706,"completed_at":"2026-10-08T16:11:03.616Z","load_balancing_strategy":"primary","db_duration_s":0.000564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 153.464672] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6f80d101f20897e9da847bfe","created_at":"2026-10-08T16:11:02.596Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76a4b17b6dec11bd69b42a222208c1de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-08T16:11:02.603Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6f80d101f20897e9da847bfe: start","job_status":"start","queue_duration_s":1.051187,"scheduling_latency_s":1.051282}1361gitlab # [ 153.516105] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6f80d101f20897e9da847bfe","created_at":"2026-10-08T16:11:02.596Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76a4b17b6dec11bd69b42a222208c1de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-08T16:11:02.603Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6f80d101f20897e9da847bfe: done: 0.051417 sec","job_status":"done","queue_duration_s":1.051187,"scheduling_latency_s":1.051282,"redis_calls":10,"redis_duration_s":0.002909,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000544762,"duration_s":0.051417,"completed_at":"2026-10-08T16:11:03.705Z","load_balancing_strategy":"primary","db_duration_s":0.004784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 153.553984] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2fcb87c21d20af1a3282444c","created_at":"2026-10-08T16:11:02.610Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1909674bf01a851dea07f62ee1f3b9b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.617Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2fcb87c21d20af1a3282444c: start","job_status":"start","queue_duration_s":1.126754,"scheduling_latency_s":1.126794}1363gitlab # [ 153.591782] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2fcb87c21d20af1a3282444c","created_at":"2026-10-08T16:11:02.610Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1909674bf01a851dea07f62ee1f3b9b8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.617Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2fcb87c21d20af1a3282444c: done: 0.037808 sec","job_status":"done","queue_duration_s":1.126754,"scheduling_latency_s":1.126794,"redis_calls":10,"redis_duration_s":0.00227,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000434,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000505,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000389156,"duration_s":0.037808,"completed_at":"2026-10-08T16:11:03.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 153.631134] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.821Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"f3cc7c03cd7d76a7abfa4904","created_at":"2026-10-08T16:11:02.623Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.629Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-f3cc7c03cd7d76a7abfa4904: start","job_status":"start","queue_duration_s":1.191267,"scheduling_latency_s":1.191308}1365gitlab # [ 153.688072] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"f3cc7c03cd7d76a7abfa4904","created_at":"2026-10-08T16:11:02.623Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.629Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-f3cc7c03cd7d76a7abfa4904: done: 0.05713 sec","job_status":"done","queue_duration_s":1.191267,"scheduling_latency_s":1.191308,"redis_calls":28,"redis_duration_s":0.007562,"redis_read_bytes":36,"redis_write_bytes":10603,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001252,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000476,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.004145,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001689,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302831,"duration_s":0.05713,"completed_at":"2026-10-08T16:11:03.878Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 153.728443] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.918Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cbac99d901cd6f83c0982c86","created_at":"2026-10-08T16:11:02.635Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"505828aa6dae442021bbfe926ffe34a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.642Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cbac99d901cd6f83c0982c86: start","job_status":"start","queue_duration_s":1.276056,"scheduling_latency_s":1.276087}1367gitlab # [ 153.760843] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.951Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1368gitlab # [ 153.772640] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:03.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"cbac99d901cd6f83c0982c86","created_at":"2026-10-08T16:11:02.635Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"505828aa6dae442021bbfe926ffe34a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.642Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-cbac99d901cd6f83c0982c86: done: 0.043861 sec","job_status":"done","queue_duration_s":1.276056,"scheduling_latency_s":1.276087,"redis_calls":10,"redis_duration_s":0.003175,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000612,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000490565,"duration_s":0.043861,"completed_at":"2026-10-08T16:11:03.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 153.811729] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b33fac59fa96a852b0a01918","created_at":"2026-10-08T16:11:02.652Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13a2f9ca8a2276cf4625efacb1086033","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.660Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b33fac59fa96a852b0a01918: start","job_status":"start","queue_duration_s":1.341473,"scheduling_latency_s":1.341508}1370gitlab # [ 153.853506] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b33fac59fa96a852b0a01918","created_at":"2026-10-08T16:11:02.652Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13a2f9ca8a2276cf4625efacb1086033","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.660Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b33fac59fa96a852b0a01918: done: 0.041801 sec","job_status":"done","queue_duration_s":1.341473,"scheduling_latency_s":1.341508,"redis_calls":13,"redis_duration_s":0.003887,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001973,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012254351,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.041801,"completed_at":"2026-10-08T16:11:04.043Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005745,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1371gitlab # [ 153.895186] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2f9d1ea52a2c657e20995d78","created_at":"2026-10-08T16:11:02.666Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f76956f62e5730dc38fb06dd277fca04","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.672Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2f9d1ea52a2c657e20995d78: start","job_status":"start","queue_duration_s":1.412833,"scheduling_latency_s":1.412868}1372gitlab # [ 153.943682] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.132Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2f9d1ea52a2c657e20995d78","created_at":"2026-10-08T16:11:02.666Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f76956f62e5730dc38fb06dd277fca04","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.672Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2f9d1ea52a2c657e20995d78: done: 0.047952 sec","job_status":"done","queue_duration_s":1.412833,"scheduling_latency_s":1.412868,"redis_calls":10,"redis_duration_s":0.0030540000000000003,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000558,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527162,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.047952,"completed_at":"2026-10-08T16:11:04.132Z","load_balancing_strategy":"primary","db_duration_s":0.017253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 153.946183] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8d2a947ac7b2a2b82de12409","created_at":"2026-10-08T16:11:02.682Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8c5b2718871408e6d8583d9fae6c56c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.689Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8d2a947ac7b2a2b82de12409: start","job_status":"start","queue_duration_s":1.447102,"scheduling_latency_s":1.447149}1374gitlab # [ 153.982804] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8d2a947ac7b2a2b82de12409","created_at":"2026-10-08T16:11:02.682Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8c5b2718871408e6d8583d9fae6c56c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.689Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8d2a947ac7b2a2b82de12409: done: 0.03673 sec","job_status":"done","queue_duration_s":1.447102,"scheduling_latency_s":1.447149,"redis_calls":12,"redis_duration_s":0.003471,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001186,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000841727,"exclusive_lock_hold_duration_s":0.008579583,"duration_s":0.03673,"completed_at":"2026-10-08T16:11:04.172Z","load_balancing_strategy":"primary","db_duration_s":0.003629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 153.992584] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.174Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e937271a67d8f0053cba2b92","created_at":"2026-10-08T16:11:02.694Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5af3e087c8c5db2bc4872a6918cb05f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.699Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e937271a67d8f0053cba2b92: start","job_status":"start","queue_duration_s":1.474997,"scheduling_latency_s":1.475022}1376gitlab # [ 154.030878] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.184Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1377gitlab # [ 154.031633] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e937271a67d8f0053cba2b92","created_at":"2026-10-08T16:11:02.694Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5af3e087c8c5db2bc4872a6918cb05f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.699Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e937271a67d8f0053cba2b92: done: 0.014255 sec","job_status":"done","queue_duration_s":1.474997,"scheduling_latency_s":1.475022,"redis_calls":10,"redis_duration_s":0.001448,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000432,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201143,"duration_s":0.014255,"completed_at":"2026-10-08T16:11:04.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001031,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 154.045635] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b8aeb3acb36aec0f8a6ce2a6","created_at":"2026-10-08T16:11:02.704Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cde29d0cf7b3e1b5c761d208774b38ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.708Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b8aeb3acb36aec0f8a6ce2a6: start","job_status":"start","queue_duration_s":1.481452,"scheduling_latency_s":1.481465}1379gitlab # [ 154.058662] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.196Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1380gitlab # [ 154.061591] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"b8aeb3acb36aec0f8a6ce2a6","created_at":"2026-10-08T16:11:02.704Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cde29d0cf7b3e1b5c761d208774b38ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.708Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-b8aeb3acb36aec0f8a6ce2a6: done: 0.011251 sec","job_status":"done","queue_duration_s":1.481452,"scheduling_latency_s":1.481465,"redis_calls":10,"redis_duration_s":0.00125,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000195835,"duration_s":0.011251,"completed_at":"2026-10-08T16:11:04.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 154.104662] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ca78a22da1b432b6970ba646","created_at":"2026-10-08T16:11:02.713Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b5336b2d0d72231ad994c804f6a0520","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.717Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ca78a22da1b432b6970ba646: start","job_status":"start","queue_duration_s":1.484332,"scheduling_latency_s":1.484345}1382gitlab # [ 154.145387] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ca78a22da1b432b6970ba646","created_at":"2026-10-08T16:11:02.713Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b5336b2d0d72231ad994c804f6a0520","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.717Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ca78a22da1b432b6970ba646: done: 0.035154 sec","job_status":"done","queue_duration_s":1.484332,"scheduling_latency_s":1.484345,"redis_calls":12,"redis_duration_s":0.0017929999999999999,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000302273,"exclusive_lock_hold_duration_s":0.018882288,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.035154,"completed_at":"2026-10-08T16:11:04.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013448,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 154.187639] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6b2cad0e207bd94bfd81e3f3","created_at":"2026-10-08T16:11:02.724Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20a68dc150c91e934d4cecba70526959","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.732Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6b2cad0e207bd94bfd81e3f3: start","job_status":"start","queue_duration_s":1.507569,"scheduling_latency_s":1.507613}1384gitlab # [ 154.188459] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"6b2cad0e207bd94bfd81e3f3","created_at":"2026-10-08T16:11:02.724Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20a68dc150c91e934d4cecba70526959","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.732Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-6b2cad0e207bd94bfd81e3f3: done: 0.025064 sec","job_status":"done","queue_duration_s":1.507569,"scheduling_latency_s":1.507613,"redis_calls":12,"redis_duration_s":0.002863,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065567,"exclusive_lock_hold_duration_s":0.003527265,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025064,"completed_at":"2026-10-08T16:11:04.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 154.236688] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d5d84306cbb99aed4c1e37ed","created_at":"2026-10-08T16:11:02.739Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.747Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d5d84306cbb99aed4c1e37ed: start","job_status":"start","queue_duration_s":1.518296,"scheduling_latency_s":1.51831}1386gitlab # [ 154.237470] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d5d84306cbb99aed4c1e37ed","created_at":"2026-10-08T16:11:02.739Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.747Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d5d84306cbb99aed4c1e37ed: done: 0.020851 sec","job_status":"done","queue_duration_s":1.518296,"scheduling_latency_s":1.51831,"redis_calls":19,"redis_duration_s":0.002403,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00054,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000179,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000198908,"duration_s":0.020851,"completed_at":"2026-10-08T16:11:04.286Z","load_balancing_strategy":"primary","db_duration_s":0.001059,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 154.254633] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b149090ae0cd38637b78f186","created_at":"2026-10-08T16:11:02.755Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89d6af0ed7d2e3d6bed7b327c40c7eca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.764Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b149090ae0cd38637b78f186: start","job_status":"start","queue_duration_s":1.523645,"scheduling_latency_s":1.523658}1388gitlab # [ 154.299702] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.294Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1389gitlab # [ 154.300596] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b149090ae0cd38637b78f186","created_at":"2026-10-08T16:11:02.755Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-76ce7dc682a64521","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89d6af0ed7d2e3d6bed7b327c40c7eca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:02.764Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b149090ae0cd38637b78f186: done: 0.011453 sec","job_status":"done","queue_duration_s":1.523645,"scheduling_latency_s":1.523658,"redis_calls":10,"redis_duration_s":0.001296,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000243,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000199746,"duration_s":0.011453,"completed_at":"2026-10-08T16:11:04.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000247,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 154.341032] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b9b1c1dbd74a98adec1fee","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b9b1c1dbd74a98adec1fee: start","job_status":"start","queue_duration_s":1.277018,"scheduling_latency_s":1.277031}1391gitlab # [ 154.341720] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3b9b1c1dbd74a98adec1fee","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3b9b1c1dbd74a98adec1fee: done: 0.013669 sec","job_status":"done","queue_duration_s":1.277018,"scheduling_latency_s":1.277031,"redis_calls":16,"redis_duration_s":0.002127,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013669,"completed_at":"2026-10-08T16:11:04.313Z","load_balancing_strategy":"primary","db_duration_s":0.000313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 154.385577] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c242d482bd6d419ef98e89b","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c242d482bd6d419ef98e89b: start","job_status":"start","queue_duration_s":1.291525,"scheduling_latency_s":1.291538}1393gitlab # [ 154.386501] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c242d482bd6d419ef98e89b","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c242d482bd6d419ef98e89b: done: 0.009668 sec","job_status":"done","queue_duration_s":1.291525,"scheduling_latency_s":1.291538,"redis_calls":13,"redis_duration_s":0.001744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009668,"completed_at":"2026-10-08T16:11:04.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 154.426045] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6f7502b6bf03007a0d5bbc1","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6f7502b6bf03007a0d5bbc1: start","job_status":"start","queue_duration_s":1.302024,"scheduling_latency_s":1.302037}1395gitlab # [ 154.426763] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6f7502b6bf03007a0d5bbc1","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6f7502b6bf03007a0d5bbc1: done: 0.009463 sec","job_status":"done","queue_duration_s":1.302024,"scheduling_latency_s":1.302037,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009463,"completed_at":"2026-10-08T16:11:04.334Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 154.471090] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c1e64ddf87c9a5c658a1654","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c1e64ddf87c9a5c658a1654: start","job_status":"start","queue_duration_s":1.312318,"scheduling_latency_s":1.312331}1397gitlab # [ 154.471793] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c1e64ddf87c9a5c658a1654","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c1e64ddf87c9a5c658a1654: done: 0.00929 sec","job_status":"done","queue_duration_s":1.312318,"scheduling_latency_s":1.312331,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00929,"completed_at":"2026-10-08T16:11:04.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 154.515789] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3c392ce6df95f3fff5f18f","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3c392ce6df95f3fff5f18f: start","job_status":"start","queue_duration_s":1.322565,"scheduling_latency_s":1.322578}1399gitlab # [ 154.516666] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3c392ce6df95f3fff5f18f","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3c392ce6df95f3fff5f18f: done: 0.009548 sec","job_status":"done","queue_duration_s":1.322565,"scheduling_latency_s":1.322578,"redis_calls":13,"redis_duration_s":0.001545,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009548,"completed_at":"2026-10-08T16:11:04.355Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 154.543468] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd7bc47609ea56afb7df326d","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd7bc47609ea56afb7df326d: start","job_status":"start","queue_duration_s":1.33309,"scheduling_latency_s":1.333103}1401gitlab # [ 154.583641] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bd7bc47609ea56afb7df326d","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bd7bc47609ea56afb7df326d: done: 0.009313 sec","job_status":"done","queue_duration_s":1.33309,"scheduling_latency_s":1.333103,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009313,"completed_at":"2026-10-08T16:11:04.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 154.589753] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef3e79495005bf1257b7489c","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef3e79495005bf1257b7489c: start","job_status":"start","queue_duration_s":1.343364,"scheduling_latency_s":1.343377}1403gitlab # [ 154.600985] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef3e79495005bf1257b7489c","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef3e79495005bf1257b7489c: done: 0.00945 sec","job_status":"done","queue_duration_s":1.343364,"scheduling_latency_s":1.343377,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00945,"completed_at":"2026-10-08T16:11:04.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 154.645623] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c28ad988e5bbf583453ff33","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c28ad988e5bbf583453ff33: start","job_status":"start","queue_duration_s":1.353792,"scheduling_latency_s":1.353806}1405gitlab # [ 154.646872] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c28ad988e5bbf583453ff33","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c28ad988e5bbf583453ff33: done: 0.009481 sec","job_status":"done","queue_duration_s":1.353792,"scheduling_latency_s":1.353806,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009481,"completed_at":"2026-10-08T16:11:04.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 154.719207] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"014fe70ab2e365869824ed11","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-014fe70ab2e365869824ed11: start","job_status":"start","queue_duration_s":1.36425,"scheduling_latency_s":1.364263}1407gitlab # [ 154.719913] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"014fe70ab2e365869824ed11","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-014fe70ab2e365869824ed11: done: 0.009442 sec","job_status":"done","queue_duration_s":1.36425,"scheduling_latency_s":1.364263,"redis_calls":13,"redis_duration_s":0.0016840000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001154,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009442,"completed_at":"2026-10-08T16:11:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 154.765581] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.397Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b5dd383cd06955ebbb956de","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b5dd383cd06955ebbb956de: start","job_status":"start","queue_duration_s":1.374523,"scheduling_latency_s":1.374537}1409gitlab # [ 154.766474] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b5dd383cd06955ebbb956de","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b5dd383cd06955ebbb956de: done: 0.009439 sec","job_status":"done","queue_duration_s":1.374523,"scheduling_latency_s":1.374537,"redis_calls":13,"redis_duration_s":0.001609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009439,"completed_at":"2026-10-08T16:11:04.406Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 154.774680] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfc71def41e37306e3dc7568","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfc71def41e37306e3dc7568: start","job_status":"start","queue_duration_s":1.384792,"scheduling_latency_s":1.384805}1411gitlab # [ 154.815745] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfc71def41e37306e3dc7568","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfc71def41e37306e3dc7568: done: 0.009479 sec","job_status":"done","queue_duration_s":1.384792,"scheduling_latency_s":1.384805,"redis_calls":13,"redis_duration_s":0.0016419999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009479,"completed_at":"2026-10-08T16:11:04.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 154.821097] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a7d0a8b503409bc06d9c17f","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a7d0a8b503409bc06d9c17f: start","job_status":"start","queue_duration_s":1.395124,"scheduling_latency_s":1.395137}1413gitlab # [ 154.832629] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a7d0a8b503409bc06d9c17f","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a7d0a8b503409bc06d9c17f: done: 0.00955 sec","job_status":"done","queue_duration_s":1.395124,"scheduling_latency_s":1.395137,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00955,"completed_at":"2026-10-08T16:11:04.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 154.879502] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9ad91588330d17277937e73","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9ad91588330d17277937e73: start","job_status":"start","queue_duration_s":1.405478,"scheduling_latency_s":1.405491}1415gitlab # [ 154.880120] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9ad91588330d17277937e73","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9ad91588330d17277937e73: done: 0.009633 sec","job_status":"done","queue_duration_s":1.405478,"scheduling_latency_s":1.405491,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005978,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009633,"completed_at":"2026-10-08T16:11:04.438Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 154.914664] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b12a9621652c68093b91d45a","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b12a9621652c68093b91d45a: start","job_status":"start","queue_duration_s":1.415951,"scheduling_latency_s":1.415964}1417gitlab # [ 154.925763] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b12a9621652c68093b91d45a","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b12a9621652c68093b91d45a: done: 0.00942 sec","job_status":"done","queue_duration_s":1.415951,"scheduling_latency_s":1.415964,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00942,"completed_at":"2026-10-08T16:11:04.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 154.983300] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e128c62d9ee5d39e4931e123","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e128c62d9ee5d39e4931e123: start","job_status":"start","queue_duration_s":1.426206,"scheduling_latency_s":1.426219}1419gitlab # [ 154.984087] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e128c62d9ee5d39e4931e123","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e128c62d9ee5d39e4931e123: done: 0.009362 sec","job_status":"done","queue_duration_s":1.426206,"scheduling_latency_s":1.426219,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009362,"completed_at":"2026-10-08T16:11:04.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 155.006128] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac6d982d0a01c986838900bc","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac6d982d0a01c986838900bc: start","job_status":"start","queue_duration_s":1.436532,"scheduling_latency_s":1.436544}1421gitlab # [ 155.049669] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.471Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac6d982d0a01c986838900bc","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac6d982d0a01c986838900bc: done: 0.012247 sec","job_status":"done","queue_duration_s":1.436532,"scheduling_latency_s":1.436544,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002568,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.012247,"completed_at":"2026-10-08T16:11:04.471Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 155.051552] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ee33e337fe6254e68ecadd","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ee33e337fe6254e68ecadd: start","job_status":"start","queue_duration_s":1.449593,"scheduling_latency_s":1.449607}1423gitlab # [ 155.062676] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2ee33e337fe6254e68ecadd","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2ee33e337fe6254e68ecadd: done: 0.009431 sec","job_status":"done","queue_duration_s":1.449593,"scheduling_latency_s":1.449607,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001031,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009431,"completed_at":"2026-10-08T16:11:04.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 155.108620] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e62f5fe9b5ec20019a67c886","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e62f5fe9b5ec20019a67c886: start","job_status":"start","queue_duration_s":1.459851,"scheduling_latency_s":1.459865}1425gitlab # [ 155.109497] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e62f5fe9b5ec20019a67c886","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e62f5fe9b5ec20019a67c886: done: 0.009407 sec","job_status":"done","queue_duration_s":1.459851,"scheduling_latency_s":1.459865,"redis_calls":13,"redis_duration_s":0.001723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005871,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009407,"completed_at":"2026-10-08T16:11:04.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 155.160396] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71cdb99bba70e9281a824967","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71cdb99bba70e9281a824967: start","job_status":"start","queue_duration_s":1.470238,"scheduling_latency_s":1.470251}1427gitlab # [ 155.161063] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71cdb99bba70e9281a824967","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71cdb99bba70e9281a824967: done: 0.009329 sec","job_status":"done","queue_duration_s":1.470238,"scheduling_latency_s":1.470251,"redis_calls":13,"redis_duration_s":0.0016179999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009329,"completed_at":"2026-10-08T16:11:04.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 155.208614] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"040352fbf041e9330b6180fe","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-040352fbf041e9330b6180fe: start","job_status":"start","queue_duration_s":1.48055,"scheduling_latency_s":1.480563}1429gitlab # [ 155.209529] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"040352fbf041e9330b6180fe","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-040352fbf041e9330b6180fe: done: 0.009371 sec","job_status":"done","queue_duration_s":1.48055,"scheduling_latency_s":1.480563,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009371,"completed_at":"2026-10-08T16:11:04.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 155.233581] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a93ed2bf8fdc14be9ae0ef","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a93ed2bf8fdc14be9ae0ef: start","job_status":"start","queue_duration_s":1.491008,"scheduling_latency_s":1.491021}1431gitlab # [ 155.282576] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80a93ed2bf8fdc14be9ae0ef","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80a93ed2bf8fdc14be9ae0ef: done: 0.009365 sec","job_status":"done","queue_duration_s":1.491008,"scheduling_latency_s":1.491021,"redis_calls":13,"redis_duration_s":0.001674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009365,"completed_at":"2026-10-08T16:11:04.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 155.282740] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c73fb4f4ea2727fd8ba1af","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c73fb4f4ea2727fd8ba1af: start","job_status":"start","queue_duration_s":1.501335,"scheduling_latency_s":1.501347}1433gitlab # [ 155.290712] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25c73fb4f4ea2727fd8ba1af","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25c73fb4f4ea2727fd8ba1af: done: 0.009377 sec","job_status":"done","queue_duration_s":1.501335,"scheduling_latency_s":1.501347,"redis_calls":13,"redis_duration_s":0.0016129999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009377,"completed_at":"2026-10-08T16:11:04.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 155.357609] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55a1098de082b72b9ae765f7","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55a1098de082b72b9ae765f7: start","job_status":"start","queue_duration_s":1.511693,"scheduling_latency_s":1.511706}1435gitlab # [ 155.358459] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55a1098de082b72b9ae765f7","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55a1098de082b72b9ae765f7: done: 0.00941 sec","job_status":"done","queue_duration_s":1.511693,"scheduling_latency_s":1.511706,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00941,"completed_at":"2026-10-08T16:11:04.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 155.401326] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41386661c3006d6d07bcca27","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41386661c3006d6d07bcca27: start","job_status":"start","queue_duration_s":1.522067,"scheduling_latency_s":1.522081}1437gitlab # [ 155.402031] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41386661c3006d6d07bcca27","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41386661c3006d6d07bcca27: done: 0.009311 sec","job_status":"done","queue_duration_s":1.522067,"scheduling_latency_s":1.522081,"redis_calls":13,"redis_duration_s":0.0015470000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009311,"completed_at":"2026-10-08T16:11:04.554Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 155.416693] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"538207f5a84ded3f91c49481","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-538207f5a84ded3f91c49481: start","job_status":"start","queue_duration_s":1.5322,"scheduling_latency_s":1.532213}1439gitlab # [ 155.460096] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"538207f5a84ded3f91c49481","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-538207f5a84ded3f91c49481: done: 0.009528 sec","job_status":"done","queue_duration_s":1.5322,"scheduling_latency_s":1.532213,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009528,"completed_at":"2026-10-08T16:11:04.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 155.462485] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e3882756a94d7876da7c1f","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e3882756a94d7876da7c1f: start","job_status":"start","queue_duration_s":1.542554,"scheduling_latency_s":1.542568}1441gitlab # [ 155.505736] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e3882756a94d7876da7c1f","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e3882756a94d7876da7c1f: done: 0.00966 sec","job_status":"done","queue_duration_s":1.542554,"scheduling_latency_s":1.542568,"redis_calls":13,"redis_duration_s":0.0016350000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00966,"completed_at":"2026-10-08T16:11:04.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 155.507664] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"444987e0ab7e7f9d62fcc621","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-444987e0ab7e7f9d62fcc621: start","job_status":"start","queue_duration_s":1.553054,"scheduling_latency_s":1.553066}1443gitlab # [ 155.548858] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"444987e0ab7e7f9d62fcc621","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-444987e0ab7e7f9d62fcc621: done: 0.009579 sec","job_status":"done","queue_duration_s":1.553054,"scheduling_latency_s":1.553066,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009579,"completed_at":"2026-10-08T16:11:04.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 155.553217] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"097406c023021b59dbaa156a","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-097406c023021b59dbaa156a: start","job_status":"start","queue_duration_s":1.563641,"scheduling_latency_s":1.563654}1445gitlab # [ 155.564762] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"097406c023021b59dbaa156a","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-097406c023021b59dbaa156a: done: 0.009449 sec","job_status":"done","queue_duration_s":1.563641,"scheduling_latency_s":1.563654,"redis_calls":13,"redis_duration_s":0.001638,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009449,"completed_at":"2026-10-08T16:11:04.596Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 155.626870] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bb3b2f7e4371d383e8cf629","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bb3b2f7e4371d383e8cf629: start","job_status":"start","queue_duration_s":1.573918,"scheduling_latency_s":1.573931}1447gitlab # [ 155.627575] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bb3b2f7e4371d383e8cf629","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bb3b2f7e4371d383e8cf629: done: 0.009277 sec","job_status":"done","queue_duration_s":1.573918,"scheduling_latency_s":1.573931,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009277,"completed_at":"2026-10-08T16:11:04.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 155.646074] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c35470da8111e68c339273f8","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c35470da8111e68c339273f8: start","job_status":"start","queue_duration_s":1.584163,"scheduling_latency_s":1.584176}1449gitlab # [ 155.657241] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c35470da8111e68c339273f8","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c35470da8111e68c339273f8: done: 0.009306 sec","job_status":"done","queue_duration_s":1.584163,"scheduling_latency_s":1.584176,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009306,"completed_at":"2026-10-08T16:11:04.616Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 155.704106] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19516cf0f1068bf26bea7165","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19516cf0f1068bf26bea7165: start","job_status":"start","queue_duration_s":1.594431,"scheduling_latency_s":1.594445}1451gitlab # [ 155.704765] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"19516cf0f1068bf26bea7165","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-19516cf0f1068bf26bea7165: done: 0.009271 sec","job_status":"done","queue_duration_s":1.594431,"scheduling_latency_s":1.594445,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009271,"completed_at":"2026-10-08T16:11:04.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 155.746311] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8678232282b8d00cdcd1975b","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8678232282b8d00cdcd1975b: start","job_status":"start","queue_duration_s":1.604686,"scheduling_latency_s":1.604699}1453gitlab # [ 155.748143] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8678232282b8d00cdcd1975b","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8678232282b8d00cdcd1975b: done: 0.009382 sec","job_status":"done","queue_duration_s":1.604686,"scheduling_latency_s":1.604699,"redis_calls":13,"redis_duration_s":0.0016449999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009382,"completed_at":"2026-10-08T16:11:04.637Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 155.806059] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16b02e32a8a9bf64898a75bb","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16b02e32a8a9bf64898a75bb: start","job_status":"start","queue_duration_s":1.615056,"scheduling_latency_s":1.615068}1455gitlab # [ 155.806788] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16b02e32a8a9bf64898a75bb","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16b02e32a8a9bf64898a75bb: done: 0.009237 sec","job_status":"done","queue_duration_s":1.615056,"scheduling_latency_s":1.615068,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009237,"completed_at":"2026-10-08T16:11:04.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 155.862561] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8d3c7673823035529783e7b","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8d3c7673823035529783e7b: start","job_status":"start","queue_duration_s":1.625276,"scheduling_latency_s":1.62529}1457gitlab # [ 155.863448] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8d3c7673823035529783e7b","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8d3c7673823035529783e7b: done: 0.009351 sec","job_status":"done","queue_duration_s":1.625276,"scheduling_latency_s":1.62529,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009351,"completed_at":"2026-10-08T16:11:04.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 155.874765] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7b2aef3370742aef43a7b50","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7b2aef3370742aef43a7b50: start","job_status":"start","queue_duration_s":1.635423,"scheduling_latency_s":1.635436}1459gitlab # [ 155.886049] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7b2aef3370742aef43a7b50","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7b2aef3370742aef43a7b50: done: 0.009359 sec","job_status":"done","queue_duration_s":1.635423,"scheduling_latency_s":1.635436,"redis_calls":13,"redis_duration_s":0.001557,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009359,"completed_at":"2026-10-08T16:11:04.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 155.936764] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970ade4ff70252be3dfba0bf","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970ade4ff70252be3dfba0bf: start","job_status":"start","queue_duration_s":1.645629,"scheduling_latency_s":1.645641}1461gitlab # [ 155.937518] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"970ade4ff70252be3dfba0bf","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-970ade4ff70252be3dfba0bf: done: 0.009483 sec","job_status":"done","queue_duration_s":1.645629,"scheduling_latency_s":1.645641,"redis_calls":13,"redis_duration_s":0.00159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009483,"completed_at":"2026-10-08T16:11:04.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 155.992665] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff22dc983464b86ca01f5af1","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff22dc983464b86ca01f5af1: start","job_status":"start","queue_duration_s":1.655943,"scheduling_latency_s":1.655957}1463gitlab # [ 155.993568] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff22dc983464b86ca01f5af1","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff22dc983464b86ca01f5af1: done: 0.009909 sec","job_status":"done","queue_duration_s":1.655943,"scheduling_latency_s":1.655957,"redis_calls":13,"redis_duration_s":0.0017490000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009909,"completed_at":"2026-10-08T16:11:04.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 156.047064] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1e3417e12788bb69894d397","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1e3417e12788bb69894d397: start","job_status":"start","queue_duration_s":1.66668,"scheduling_latency_s":1.666693}1465gitlab # [ 156.047724] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1e3417e12788bb69894d397","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1e3417e12788bb69894d397: done: 0.00951 sec","job_status":"done","queue_duration_s":1.66668,"scheduling_latency_s":1.666693,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00951,"completed_at":"2026-10-08T16:11:04.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 156.057556] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9828d0412d9b60e600b66f27","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9828d0412d9b60e600b66f27: start","job_status":"start","queue_duration_s":1.677035,"scheduling_latency_s":1.677048}1467gitlab # [ 156.069364] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9828d0412d9b60e600b66f27","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9828d0412d9b60e600b66f27: done: 0.009448 sec","job_status":"done","queue_duration_s":1.677035,"scheduling_latency_s":1.677048,"redis_calls":13,"redis_duration_s":0.001596,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009448,"completed_at":"2026-10-08T16:11:04.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 156.128510] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2f2c52f4b8659b836351875","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2f2c52f4b8659b836351875: start","job_status":"start","queue_duration_s":1.687319,"scheduling_latency_s":1.687331}1469gitlab # [ 156.129248] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2f2c52f4b8659b836351875","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2f2c52f4b8659b836351875: done: 0.009375 sec","job_status":"done","queue_duration_s":1.687319,"scheduling_latency_s":1.687331,"redis_calls":13,"redis_duration_s":0.0016740000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009375,"completed_at":"2026-10-08T16:11:04.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 156.149740] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a5f0567525a67f276fdd1f6","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a5f0567525a67f276fdd1f6: start","job_status":"start","queue_duration_s":1.697687,"scheduling_latency_s":1.6977}1471gitlab # [ 156.196128] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a5f0567525a67f276fdd1f6","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a5f0567525a67f276fdd1f6: done: 0.009396 sec","job_status":"done","queue_duration_s":1.697687,"scheduling_latency_s":1.6977,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009396,"completed_at":"2026-10-08T16:11:04.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 156.196764] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d096aeede68a38caa83e83","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d096aeede68a38caa83e83: start","job_status":"start","queue_duration_s":1.708057,"scheduling_latency_s":1.708071}1473gitlab # [ 156.206753] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d096aeede68a38caa83e83","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d096aeede68a38caa83e83: done: 0.009832 sec","job_status":"done","queue_duration_s":1.708057,"scheduling_latency_s":1.708071,"redis_calls":13,"redis_duration_s":0.0016020000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009832,"completed_at":"2026-10-08T16:11:04.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 156.273812] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461a4c16021f946747d72f35","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461a4c16021f946747d72f35: start","job_status":"start","queue_duration_s":1.718912,"scheduling_latency_s":1.718925}1475gitlab # [ 156.274677] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"461a4c16021f946747d72f35","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-461a4c16021f946747d72f35: done: 0.009738 sec","job_status":"done","queue_duration_s":1.718912,"scheduling_latency_s":1.718925,"redis_calls":13,"redis_duration_s":0.001805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009738,"completed_at":"2026-10-08T16:11:04.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 156.287654] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15739b426d8af3b6934dd28e","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15739b426d8af3b6934dd28e: start","job_status":"start","queue_duration_s":1.729635,"scheduling_latency_s":1.729647}1477gitlab # [ 156.299184] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15739b426d8af3b6934dd28e","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15739b426d8af3b6934dd28e: done: 0.009325 sec","job_status":"done","queue_duration_s":1.729635,"scheduling_latency_s":1.729647,"redis_calls":13,"redis_duration_s":0.0015929999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009325,"completed_at":"2026-10-08T16:11:04.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 156.349327] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99e5306c9af3326abd7dd784","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99e5306c9af3326abd7dd784: start","job_status":"start","queue_duration_s":1.739946,"scheduling_latency_s":1.739959}1479gitlab # [ 156.350095] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99e5306c9af3326abd7dd784","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99e5306c9af3326abd7dd784: done: 0.009378 sec","job_status":"done","queue_duration_s":1.739946,"scheduling_latency_s":1.739959,"redis_calls":13,"redis_duration_s":0.0016619999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009378,"completed_at":"2026-10-08T16:11:04.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 156.380621] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8db4b474391fb9f3ce5e3ecd","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8db4b474391fb9f3ce5e3ecd: start","job_status":"start","queue_duration_s":1.750333,"scheduling_latency_s":1.750346}1481gitlab # [ 156.427543] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8db4b474391fb9f3ce5e3ecd","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8db4b474391fb9f3ce5e3ecd: done: 0.009347 sec","job_status":"done","queue_duration_s":1.750333,"scheduling_latency_s":1.750346,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009347,"completed_at":"2026-10-08T16:11:04.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 156.428639] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60fe77d5cb0a9fb3c8c6f95c","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60fe77d5cb0a9fb3c8c6f95c: start","job_status":"start","queue_duration_s":1.760476,"scheduling_latency_s":1.760489}1483gitlab # [ 156.437031] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60fe77d5cb0a9fb3c8c6f95c","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60fe77d5cb0a9fb3c8c6f95c: done: 0.009667 sec","job_status":"done","queue_duration_s":1.760476,"scheduling_latency_s":1.760489,"redis_calls":13,"redis_duration_s":0.0017429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009667,"completed_at":"2026-10-08T16:11:04.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 156.472700] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa3503ac744d26498f8e860","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa3503ac744d26498f8e860: start","job_status":"start","queue_duration_s":1.77102,"scheduling_latency_s":1.771032}1485gitlab # [ 156.517726] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caa3503ac744d26498f8e860","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caa3503ac744d26498f8e860: done: 0.010029 sec","job_status":"done","queue_duration_s":1.77102,"scheduling_latency_s":1.771032,"redis_calls":13,"redis_duration_s":0.0020879999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001102,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010029,"completed_at":"2026-10-08T16:11:04.804Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 156.518696] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76255c6e40a8d6331c031eac","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76255c6e40a8d6331c031eac: start","job_status":"start","queue_duration_s":1.781896,"scheduling_latency_s":1.781909}1487gitlab # [ 156.529075] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76255c6e40a8d6331c031eac","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76255c6e40a8d6331c031eac: done: 0.009488 sec","job_status":"done","queue_duration_s":1.781896,"scheduling_latency_s":1.781909,"redis_calls":13,"redis_duration_s":0.001596,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009488,"completed_at":"2026-10-08T16:11:04.814Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 156.572058] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d2a942c8d653aab5c8403b5","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d2a942c8d653aab5c8403b5: start","job_status":"start","queue_duration_s":1.792249,"scheduling_latency_s":1.792262}1489gitlab # [ 156.574581] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d2a942c8d653aab5c8403b5","created_at":"2026-10-08T16:11:02.960Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-fe02dd1c58d94694","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c51d06192c56a202e961a120880bce","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.023Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d2a942c8d653aab5c8403b5: done: 0.009438 sec","job_status":"done","queue_duration_s":1.792249,"scheduling_latency_s":1.792262,"redis_calls":13,"redis_duration_s":0.001561,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001056,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009438,"completed_at":"2026-10-08T16:11:04.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 156.614213] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ab48f78417bbfc03aaf8f315","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ab48f78417bbfc03aaf8f315: start","job_status":"start","queue_duration_s":0.95343,"scheduling_latency_s":0.953444}1491gitlab # [ 156.620821] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ab48f78417bbfc03aaf8f315","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ab48f78417bbfc03aaf8f315: done: 0.091673 sec","job_status":"done","queue_duration_s":0.95343,"scheduling_latency_s":0.953444,"redis_calls":16,"redis_duration_s":0.00258,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001615,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.068,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000250311,"duration_s":0.091673,"completed_at":"2026-10-08T16:11:04.917Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 156.665796] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0c533a471c54e09044b8918e","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0c533a471c54e09044b8918e: start","job_status":"start","queue_duration_s":1.046193,"scheduling_latency_s":1.046208}1493gitlab # [ 156.668720] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0c533a471c54e09044b8918e","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0c533a471c54e09044b8918e: done: 0.01333 sec","job_status":"done","queue_duration_s":1.046193,"scheduling_latency_s":1.046208,"redis_calls":13,"redis_duration_s":0.001756,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01333,"completed_at":"2026-10-08T16:11:04.931Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 156.733398] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d23fdc6a378374b6f66deb71","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d23fdc6a378374b6f66deb71: start","job_status":"start","queue_duration_s":1.060501,"scheduling_latency_s":1.060519}1495gitlab # [ 156.734159] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d23fdc6a378374b6f66deb71","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d23fdc6a378374b6f66deb71: done: 0.010205 sec","job_status":"done","queue_duration_s":1.060501,"scheduling_latency_s":1.060519,"redis_calls":13,"redis_duration_s":0.001567,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010205,"completed_at":"2026-10-08T16:11:04.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 156.936140] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2532922798 wd_nsec: 25329225751497gitlab # [ 156.790083] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"869ef9bd5b592a6c4d1533b0","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-869ef9bd5b592a6c4d1533b0: start","job_status":"start","queue_duration_s":1.071677,"scheduling_latency_s":1.07169}1498gitlab # [ 156.791546] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"869ef9bd5b592a6c4d1533b0","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-869ef9bd5b592a6c4d1533b0: done: 0.009702 sec","job_status":"done","queue_duration_s":1.071677,"scheduling_latency_s":1.07169,"redis_calls":13,"redis_duration_s":0.001551,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009702,"completed_at":"2026-10-08T16:11:04.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 156.798348] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"717df193893f906e8ee051c3","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-717df193893f906e8ee051c3: start","job_status":"start","queue_duration_s":1.08234,"scheduling_latency_s":1.082353}1500gitlab # [ 156.810590] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"717df193893f906e8ee051c3","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-717df193893f906e8ee051c3: done: 0.011913 sec","job_status":"done","queue_duration_s":1.08234,"scheduling_latency_s":1.082353,"redis_calls":13,"redis_duration_s":0.001633,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011913,"completed_at":"2026-10-08T16:11:04.966Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 156.869837] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0e8ddccda28c2cc094f118a4","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0e8ddccda28c2cc094f118a4: start","job_status":"start","queue_duration_s":1.095209,"scheduling_latency_s":1.095222}1502gitlab # [ 156.870677] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"0e8ddccda28c2cc094f118a4","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-0e8ddccda28c2cc094f118a4: done: 0.010743 sec","job_status":"done","queue_duration_s":1.095209,"scheduling_latency_s":1.095222,"redis_calls":13,"redis_duration_s":0.001583,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010743,"completed_at":"2026-10-08T16:11:04.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503gitlab # [ 156.911263] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7262afcd4792fe959df2ec4","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7262afcd4792fe959df2ec4: start","job_status":"start","queue_duration_s":1.106955,"scheduling_latency_s":1.106969}1504gitlab # [ 156.911997] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b7262afcd4792fe959df2ec4","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b7262afcd4792fe959df2ec4: done: 0.009942 sec","job_status":"done","queue_duration_s":1.106955,"scheduling_latency_s":1.106969,"redis_calls":13,"redis_duration_s":0.00155,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009942,"completed_at":"2026-10-08T16:11:04.989Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505gitlab # [ 156.971754] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:04.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8e373ecd118f515a7448babc","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8e373ecd118f515a7448babc: start","job_status":"start","queue_duration_s":1.117837,"scheduling_latency_s":1.117851}1506gitlab # [ 156.972768] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"8e373ecd118f515a7448babc","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-8e373ecd118f515a7448babc: done: 0.010697 sec","job_status":"done","queue_duration_s":1.117837,"scheduling_latency_s":1.117851,"redis_calls":13,"redis_duration_s":0.0016719999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001129,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010697,"completed_at":"2026-10-08T16:11:05.000Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507gitlab # [ 157.012699] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"023f0d68fe15c9a751478e54","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-023f0d68fe15c9a751478e54: start","job_status":"start","queue_duration_s":1.129536,"scheduling_latency_s":1.129549}1508gitlab # [ 157.013462] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"023f0d68fe15c9a751478e54","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-023f0d68fe15c9a751478e54: done: 0.01081 sec","job_status":"done","queue_duration_s":1.129536,"scheduling_latency_s":1.129549,"redis_calls":13,"redis_duration_s":0.001963,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000665,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001298,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01081,"completed_at":"2026-10-08T16:11:05.012Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000426,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509gitlab # [ 157.033943] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7271360a5b9385dbc0b4f85b","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7271360a5b9385dbc0b4f85b: start","job_status":"start","queue_duration_s":1.141373,"scheduling_latency_s":1.141388}1510gitlab # [ 157.074081] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7271360a5b9385dbc0b4f85b","created_at":"2026-10-08T16:11:03.848Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-11eb34ae393c42d9","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"840d6c591934f70d228be6eeba6a4dbf","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:03.872Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7271360a5b9385dbc0b4f85b: done: 0.010023 sec","job_status":"done","queue_duration_s":1.141373,"scheduling_latency_s":1.141388,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010023,"completed_at":"2026-10-08T16:11:05.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511gitlab # [ 157.081195] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.024Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dcdd8db139c1896df3cbc7cd","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dcdd8db139c1896df3cbc7cd: start","job_status":"start","queue_duration_s":0.742947,"scheduling_latency_s":0.74296}1512gitlab # [ 157.130459] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.034Z","message":"No existing merge request to be cleaned up."}1513gitlab # [ 157.131234] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.042Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dcdd8db139c1896df3cbc7cd","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dcdd8db139c1896df3cbc7cd: done: 0.017791 sec","job_status":"done","queue_duration_s":0.742947,"scheduling_latency_s":0.74296,"redis_calls":13,"redis_duration_s":0.001759,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000237181,"duration_s":0.017791,"completed_at":"2026-10-08T16:11:05.042Z","load_balancing_strategy":"primary","db_duration_s":0.001972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 157.132226] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.043Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f78faa152a2789f9f14fe63e","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f78faa152a2789f9f14fe63e: start","job_status":"start","queue_duration_s":0.761712,"scheduling_latency_s":0.761725}1515gitlab # [ 157.172568] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.049Z","message":"No existing merge request to be cleaned up."}1516gitlab # [ 157.173242] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.054Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f78faa152a2789f9f14fe63e","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f78faa152a2789f9f14fe63e: done: 0.011069 sec","job_status":"done","queue_duration_s":0.761712,"scheduling_latency_s":0.761725,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011069,"completed_at":"2026-10-08T16:11:05.054Z","load_balancing_strategy":"primary","db_duration_s":0.000967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 157.176906] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.055Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3d3be764812ad76944ba457b","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3d3be764812ad76944ba457b: start","job_status":"start","queue_duration_s":0.773653,"scheduling_latency_s":0.773667}1518gitlab # [ 157.188495] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.061Z","message":"No existing merge request to be cleaned up."}1519gitlab # [ 157.189761] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.066Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3d3be764812ad76944ba457b","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3d3be764812ad76944ba457b: done: 0.010829 sec","job_status":"done","queue_duration_s":0.773653,"scheduling_latency_s":0.773667,"redis_calls":10,"redis_duration_s":0.0012790000000000002,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000755,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010829,"completed_at":"2026-10-08T16:11:05.066Z","load_balancing_strategy":"primary","db_duration_s":0.000911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 157.238512] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.067Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3f2f5ae17143498d95348b2c","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3f2f5ae17143498d95348b2c: start","job_status":"start","queue_duration_s":0.785368,"scheduling_latency_s":0.785382}1521gitlab # [ 157.239271] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.073Z","message":"No existing merge request to be cleaned up."}1522gitlab # [ 157.239709] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:05.077Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3f2f5ae17143498d95348b2c","created_at":"2026-10-08T16:11:04.274Z","trace_propagation_headers":{"sentry-trace":"42376fc798344011b6d2e581e6465d48-dee3ac7a47464ffc","baggage":"sentry-trace_id=42376fc798344011b6d2e581e6465d48,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b18f63f2254db5ff282b4ad311c25d96","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:04.281Z","job_size_bytes":2,"pid":1611,"sidekiq_tid":"maeb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3f2f5ae17143498d95348b2c: done: 0.010953 sec","job_status":"done","queue_duration_s":0.785368,"scheduling_latency_s":0.785382,"redis_calls":10,"redis_duration_s":0.001539,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010953,"completed_at":"2026-10-08T16:11:05.077Z","load_balancing_strategy":"primary","db_duration_s":0.000934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 158.072920] setup-gitlab-start[2200]: W, [2026-10-08T16:11:08.262680 #2200] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1524gitlab # [ 178.351513] postgres[2384]: [2384] ERROR: relation "table_without_models" does not exist1525gitlab # [ 178.352393] postgres[2384]: [2384] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1526gitlab # [ 181.228534] runuser[2199]: pam_unix(runuser:session): session closed for user gitlab1527gitlab # [ 181.229436] setup-gitlab-start[2181]: + systemctl restart gitlab-sidekiq.service1528gitlab # [ 181.258708] systemd[1]: Stopping gitlab-sidekiq.service...1529gitlab # [ 181.259221] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:31.448Z","message":"Shutting down"}1530gitlab # [ 181.260068] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:31.449Z","message":"Scheduler exiting..."}1531gitlab # [ 181.266412] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:31.456Z","message":"Terminating quiet threads for default capsule"}1532gitlab # [ 181.266685] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:31.457Z","message":"Scheduler exiting..."}1533gitlab # [ 181.774493] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:31.964Z","message":"Pausing to allow jobs to finish..."}1534gitlab # [ 185.279267] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:35.468Z","message":"Bye!"}1535gitlab # [ 185.301697] sidekiq-cluster[1611]: {"severity":"INFO","time":"2026-10-08T16:11:35.491Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1611,"worker_id":"sidekiq_0","memwd_rss_bytes":941531136,"retry":0}1536gitlab # [ 185.873331] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1537gitlab # [ 185.875977] systemd[1]: Stopped gitlab-sidekiq.service.1538gitlab # [ 185.877831] systemd[1]: gitlab-sidekiq.service: Consumed 54.247s CPU time over 1min 53.104s wall clock time, 959.3M memory peak, 4.5M read from disk.1539gitlab # [ 185.888157] systemd[1]: Started gitlab-sidekiq.service.1540gitlab # [ 185.890804] setup-gitlab-start[2181]: + mkdir -p /var/lib/secrets1541gitlab # [ 185.893096] setup-gitlab-start[2181]: + echo nixbot-test-token-of-20-chars1542gitlab # [ 185.895371] setup-gitlab-start[2181]: + chmod 644 /var/lib/secrets/gitlab-token1543gitlab # [ 185.897780] setup-gitlab-start[2181]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1544gitlab # [ 186.369777] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:36 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 4471545gitlab # [ 186.856881] gitaly[892]: time="2026-10-08T16:11:37.046Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.046" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 186.878649] gitaly[892]: time="2026-10-08T16:11:37.046Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.046" grpc.time_ms=0.292 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1547gitlab # [ 187.011316] gitaly[892]: time="2026-10-08T16:11:37.201Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.160" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.201" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1548gitlab # [ 187.033550] gitaly[892]: time="2026-10-08T16:11:37.201Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.160" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.201" grpc.time_ms=0.412 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1549gitlab # [ 187.115121] gitaly[892]: time="2026-10-08T16:11:37.305Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H diskcache=15704b3c-4328-4e13-9bee-a2e0390bcf36 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-08T16:11:47.207" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.248" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1550gitlab # [ 187.115607] gitaly[892]: time="2026-10-08T16:11:37.305Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1573 command.oublock=32 command.real_time_ms=25 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-08T16:11:47.207" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.248" grpc.time_ms=56.989 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1551gitlab # [ 187.133605] gitaly[892]: time="2026-10-08T16:11:37.323Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.282" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.323" pid=892 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1552gitlab # [ 187.135377] gitaly[892]: time="2026-10-08T16:11:37.324Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.282" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.323" grpc.time_ms=0.826 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1553gitlab # [ 187.151504] gitaly[892]: time="2026-10-08T16:11:37.341Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:11:47.290" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.330" grpc.time_ms=10.748 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 187.203596] gitaly[892]: time="2026-10-08T16:11:37.394Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.393" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1555gitlab # [ 187.204909] gitaly[892]: time="2026-10-08T16:11:37.394Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.393" grpc.time_ms=0.207 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1556gitlab # [ 187.262376] gitaly[892]: time="2026-10-08T16:11:37.452Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H diskcache=4203e651-e66e-48ff-b389-592f7f00146a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-08T16:11:47.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.414" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1557gitlab # [ 187.263191] gitaly[892]: time="2026-10-08T16:11:37.452Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1574 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-08T16:11:47.023" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.414" grpc.time_ms=38.736 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1558gitlab # [ 187.290913] gitaly[892]: time="2026-10-08T16:11:37.481Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.090" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.481" pid=892 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1559gitlab # [ 187.291693] gitaly[892]: time="2026-10-08T16:11:37.481Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.090" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.481" grpc.time_ms=0.351 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1560gitlab # [ 187.324689] gitaly[892]: time="2026-10-08T16:11:37.515Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:11:47.114" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.504" grpc.time_ms=9.845 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1561gitlab # [ 187.360545] gitaly[892]: time="2026-10-08T16:11:37.550Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:11:47.160" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.550" grpc.time_ms=0.111 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1562gitlab # [ 187.371886] gitaly[892]: time="2026-10-08T16:11:37.562Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-08T16:11:47.171" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:37.562" grpc.time_ms=0.164 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1563gitlab # [ 187.880737] gitaly[892]: time="2026-10-08T16:11:38.070Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HM85YQWVRK3CVTH5J62H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:11:48.018" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:38.059" grpc.time_ms=10.976 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1564gitlab # [ 188.095928] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:38 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 17031565gitlab # [ 188.100569] setup-gitlab-start[2440]: {"id":1,"message":null,"error":null}1566gitlab # [ 188.869704] sidekiq-cluster[2427]: {"severity":"INFO","time":"2026-10-08T16:11:39.043Z","message":"Starting cluster with 1 processes"}1567gitlab # [ 193.436892] gitaly[892]: time="2026-10-08T16:11:43.626Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HTTDC236MD34S2RWJ23S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:11:53.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:43.618" grpc.time_ms=7.867 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1568gitlab # [ 193.850559] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:44 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 7301569gitlab # [ 193.859605] setup-gitlab-start[2181]: + mkdir -p /tmp/test-flake1570gitlab # [ 193.861626] setup-gitlab-start[2181]: + cd /tmp/test-flake1571gitlab # [ 193.861935] setup-gitlab-start[2181]: + git init -b master1572gitlab # [ 193.889119] setup-gitlab-start[2523]: Initialized empty Git repository in /tmp/test-flake/.git/1573gitlab # [ 193.891798] setup-gitlab-start[2181]: + git config user.name test1574gitlab # [ 193.897996] setup-gitlab-start[2181]: + git config user.email test@example.com1575gitlab # [ 193.904132] setup-gitlab-start[2181]: + cat1576gitlab # [ 193.909113] setup-gitlab-start[2181]: + git add flake.nix1577gitlab # [ 193.916520] setup-gitlab-start[2181]: + git commit -m 'initial commit'1578gitlab # [ 193.939096] setup-gitlab-start[2532]: [master (root-commit) efd9563] initial commit1579gitlab # [ 193.939231] setup-gitlab-start[2532]: 1 file changed, 10 insertions(+)1580gitlab # [ 193.939984] setup-gitlab-start[2532]: create mode 100644 flake.nix1581gitlab # [ 193.941482] setup-gitlab-start[2181]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1582gitlab # [ 193.951123] setup-gitlab-start[2181]: + git push -u origin master1583gitlab # [ 194.035071] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 521584gitlab # [ 194.154120] gitaly[892]: time="2026-10-08T16:11:44.344Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVQ32RFF0ZB0AE189B28 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:44.337" grpc.time_ms=6.45 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1585gitlab # [ 194.168368] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1311586gitlab # [ 194.392314] gitaly[892]: time="2026-10-08T16:11:44.582Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:11:54.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:44.575" grpc.time_ms=7.218 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 194.428776] gitaly[892]: time="2026-10-08T16:11:44.619Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-08T16:12:14.012" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-08T16:11:44.612" grpc.time_ms=6.563 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 194.446746] gitaly[892]: time="2026-10-08T16:11:44.636Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 duration_ms=119ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/allowed"1589gitlab # [ 194.468096] gitaly[892]: time="2026-10-08T16:11:44.658Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 duration_ms=21ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/pre_receive"1590gitlab # [ 194.469102] gitaly[892]: time="2026-10-08T16:11:44.659Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:44.516" grpc.time_ms=142.397 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1591gitlab # [ 194.501045] gitaly[892]: time="2026-10-08T16:11:44.691Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:44.690" grpc.time_ms=0.443 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1592gitlab # [ 194.538629] gitaly[892]: time="2026-10-08T16:11:44.729Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:44.728" grpc.time_ms=0.38 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1593gitlab # [ 194.575714] gitaly[892]: time="2026-10-08T16:11:44.766Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:44.765" grpc.time_ms=0.326 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1594gitlab # [ 194.650991] gitaly[892]: time="2026-10-08T16:11:44.841Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:11:54.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:44.832" grpc.time_ms=8.741 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 194.684380] gitaly[892]: time="2026-10-08T16:11:44.874Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1562 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-08T16:11:54.032" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:44.862" grpc.time_ms=11.971 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 194.713427] gitaly[892]: time="2026-10-08T16:11:44.903Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 duration_ms=111ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/post_receive"1597gitlab # [ 194.716530] gitaly[892]: time="2026-10-08T16:11:44.907Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:44.791" grpc.time_ms=115.204 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1598gitlab # [ 194.739230] gitaly[892]: time="2026-10-08T16:11:44.929Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 diskcache=6be8be49-4c6b-4ac9-8557-1a7a6a9dcf2b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:44.445" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1599gitlab # [ 194.748621] gitaly[892]: time="2026-10-08T16:11:44.929Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=186 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13761 command.oublock=32 command.real_time_ms=472 command.spawn_token_fork_ms=2 command.system_time_ms=126 command.user_time_ms=60 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:44.445" grpc.time_ms=484.288 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1600gitlab # [ 194.749183] setup-gitlab-start[2536]: To http://gitlab/root/test-flake.git1601gitlab # [ 194.749702] setup-gitlab-start[2536]: * [new branch] master -> master1602gitlab # [ 194.750229] setup-gitlab-start[2536]: branch 'master' set up to track 'origin/master'.1603gitlab # [ 194.750700] gitlab-workhorse[822]: time="2026-10-08T16:11:44Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521604gitlab # [ 194.751197] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:44 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5581605gitlab # [ 194.767956] systemd[1]: Finished setup-gitlab.service.1606gitlab # [ 194.771712] systemd[1]: Starting nixbot CI service...1607gitlab: (finished: waiting for unit setup-gitlab.service, in 195.70 seconds)1608gitlab: waiting for unit nixbot.service1609gitlab # [ 195.994266] nixbot[2612]: {"ts": "2026-10-08T16:11:46.183Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1610gitlab # [ 196.026951] nixbot[2612]: {"ts": "2026-10-08T16:11:46.217Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1611gitlab # [ 196.056911] nixbot[2612]: {"ts": "2026-10-08T16:11:46.247Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1612gitlab # [ 196.062569] nixbot[2612]: {"ts": "2026-10-08T16:11:46.252Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1613gitlab # [ 196.068867] nixbot[2612]: {"ts": "2026-10-08T16:11:46.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1614gitlab # [ 196.077270] nixbot[2612]: {"ts": "2026-10-08T16:11:46.267Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1615gitlab # [ 196.083568] nixbot[2612]: {"ts": "2026-10-08T16:11:46.273Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1616gitlab # [ 196.086307] nixbot[2612]: {"ts": "2026-10-08T16:11:46.276Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1617gitlab # [ 196.094526] nixbot[2612]: {"ts": "2026-10-08T16:11:46.284Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1618gitlab # [ 196.097532] nixbot[2612]: {"ts": "2026-10-08T16:11:46.287Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1619gitlab # [ 196.104377] nixbot[2612]: {"ts": "2026-10-08T16:11:46.294Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1620gitlab # [ 196.112384] nixbot[2612]: {"ts": "2026-10-08T16:11:46.302Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1621gitlab # [ 196.118439] nixbot[2612]: {"ts": "2026-10-08T16:11:46.308Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1622gitlab # [ 196.123311] nixbot[2612]: {"ts": "2026-10-08T16:11:46.313Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1623gitlab # [ 196.130653] nixbot[2612]: {"ts": "2026-10-08T16:11:46.320Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1624gitlab # [ 196.133763] nixbot[2612]: {"ts": "2026-10-08T16:11:46.324Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1625gitlab # [ 196.136723] nixbot[2612]: {"ts": "2026-10-08T16:11:46.327Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1626gitlab # [ 196.139569] nixbot[2612]: {"ts": "2026-10-08T16:11:46.329Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1627gitlab # [ 196.145514] nixbot[2612]: {"ts": "2026-10-08T16:11:46.335Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1628gitlab # [ 196.148499] nixbot[2612]: {"ts": "2026-10-08T16:11:46.338Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1629gitlab # [ 196.151249] nixbot[2612]: {"ts": "2026-10-08T16:11:46.341Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1630gitlab # [ 196.157992] nixbot[2612]: {"ts": "2026-10-08T16:11:46.348Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1631gitlab # [ 196.160392] nixbot[2612]: {"ts": "2026-10-08T16:11:46.350Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1632gitlab # [ 196.163338] nixbot[2612]: {"ts": "2026-10-08T16:11:46.353Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1633gitlab # [ 196.165986] nixbot[2612]: {"ts": "2026-10-08T16:11:46.356Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1634gitlab # [ 196.171502] nixbot[2612]: {"ts": "2026-10-08T16:11:46.361Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1635gitlab # [ 196.176383] nixbot[2612]: {"ts": "2026-10-08T16:11:46.366Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1636gitlab # [ 196.180389] nixbot[2612]: {"ts": "2026-10-08T16:11:46.370Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1637gitlab # [ 196.184357] nixbot[2612]: {"ts": "2026-10-08T16:11:46.374Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1638gitlab # [ 196.202964] nixbot[2612]: {"ts": "2026-10-08T16:11:46.393Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1639gitlab # [ 196.209438] nixbot[2612]: {"ts": "2026-10-08T16:11:46.399Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1640gitlab # [ 196.214273] nixbot[2612]: {"ts": "2026-10-08T16:11:46.404Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1641gitlab # [ 196.219313] nixbot[2612]: {"ts": "2026-10-08T16:11:46.409Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1642gitlab # [ 196.225856] nixbot[2612]: {"ts": "2026-10-08T16:11:46.416Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1643gitlab # [ 196.230907] nixbot[2612]: {"ts": "2026-10-08T16:11:46.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1644gitlab # [ 196.239621] nixbot[2612]: {"ts": "2026-10-08T16:11:46.429Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1645gitlab # [ 196.244990] nixbot[2612]: {"ts": "2026-10-08T16:11:46.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1646gitlab # [ 196.252388] nixbot[2612]: {"ts": "2026-10-08T16:11:46.442Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1647gitlab # [ 196.614860] nixbot[2612]: {"ts": "2026-10-08T16:11:46.805Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2612]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1648gitlab # [ 196.620744] nixbot[2612]: {"ts": "2026-10-08T16:11:46.810Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1649gitlab # [ 196.659389] nixbot[2612]: {"ts": "2026-10-08T16:11:46.849Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:42270 - \"GET /health HTTP/1.1\" 200"}1650gitlab # [ 196.666344] systemd[1]: Started nixbot CI service.1651gitlab # [ 196.667887] systemd[1]: Reached target Multi-User System.1652gitlab # [ 196.668944] systemd[1]: Startup finished in 1.275s (kernel) + 3.618s (initrd) + 3min 11.774s (userspace) = 3min 16.668s.1653gitlab # [ 196.887077] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2271654gitlab # [ 196.910766] nixbot[2612]: {"ts": "2026-10-08T16:11:47.101Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1655gitlab # [ 197.016471] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 951656gitlab # [ 197.025129] nixbot[2612]: {"ts": "2026-10-08T16:11:47.214Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1657gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds)1658gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1659gitlab # [ 197.121681] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 891660gitlab # [ 197.144534] nixbot[2612]: {"ts": "2026-10-08T16:11:47.334Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:42284 - \"GET /health HTTP/1.1\" 200"}1661gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1662subtest: project discovered and webhook registered1663gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1664gitlab # [ 197.226275] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 871665gitlab # [ 197.265484] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 811666gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds)1667(finished: subtest: project discovered and webhook registered, in 0.12 seconds)1668subtest: push delivers the webhook1669gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1670gitlab # [ 197.274759] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 321671gitlab # [ 197.338433] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 511672gitlab # [ 197.390030] gitaly[892]: time="2026-10-08T16:11:47.580Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HYYERNFHAW1QNC5QX1SD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-08T16:12:17.065" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:47.566" grpc.time_ms=13.433 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 197.409595] gitaly[892]: time="2026-10-08T16:11:47.600Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HYYERNFHAW1QNC5QX1SD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:17.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:11:47.599" grpc.time_ms=0.605 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 197.421517] gitaly[892]: time="2026-10-08T16:11:47.611Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HYYERNFHAW1QNC5QX1SD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-08T16:11:57.031" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:11:47.602" grpc.time_ms=9.758 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 197.439075] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 941676gitlab # [ 197.513373] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 691677gitlab # [ 197.523166] nixbot[2612]: {"ts": "2026-10-08T16:11:47.713Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1678gitlab # [ 197.665468] gitaly[892]: time="2026-10-08T16:11:47.855Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HZ6BJ10WJZ3EVKH8EGQF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:47.843" grpc.time_ms=11.955 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1679gitlab # [ 197.694695] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:47 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 971680gitlab # [ 197.782559] gitaly[892]: time="2026-10-08T16:11:47.972Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZ9FTFH3VP30Y8NFZ7WH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:47.962" pid=892 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1681gitlab # [ 197.804244] gitaly[892]: time="2026-10-08T16:11:47.973Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZ9FTFH3VP30Y8NFZ7WH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:47.962" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1682gitlab # [ 197.830765] gitaly[892]: time="2026-10-08T16:11:48.021Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZ9FTFH3VP30Y8NFZ7WH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:47.962" grpc.time_ms=58.39 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1683gitlab # [ 197.848757] gitlab-workhorse[822]: time="2026-10-08T16:11:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131684gitlab # [ 197.849093] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1511685gitlab # [ 197.915927] gitaly[892]: time="2026-10-08T16:11:48.106Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZEF6DM47PMAS23KVTSE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.085" pid=892 remote_ip="2001:db8:1::1" request_sha=28ca32a06f2d4b4ad6495a1f20f889a4dbed65eb response_bytes=223 span.kind=server system=grpc1686gitlab # [ 197.916243] gitaly[892]: time="2026-10-08T16:11:48.106Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZEF6DM47PMAS23KVTSE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.085" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1687gitlab # [ 197.916947] gitaly[892]: time="2026-10-08T16:11:48.106Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1205 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZEF6DM47PMAS23KVTSE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.085" grpc.time_ms=21.533 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1688gitlab # [ 197.918387] gitlab-workhorse[822]: time="2026-10-08T16:11:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231689gitlab # [ 197.919545] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 601690gitlab # [ 198.085304] gitaly[892]: time="2026-10-08T16:11:48.275Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HZKH040MTBG6N8YDEHZW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.264" grpc.time_ms=11.327 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1691gitlab # [ 198.085912] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 661692gitlab # [ 198.167859] gitaly[892]: time="2026-10-08T16:11:48.358Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZPNQYSV8G45GNEH4X0W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.347" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1693gitlab # [ 198.168131] gitaly[892]: time="2026-10-08T16:11:48.358Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZPNQYSV8G45GNEH4X0W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.347" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1694gitlab # [ 198.168838] gitaly[892]: time="2026-10-08T16:11:48.359Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZPNQYSV8G45GNEH4X0W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.347" grpc.time_ms=11.647 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1695gitlab # [ 198.169936] gitlab-workhorse[822]: time="2026-10-08T16:11:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671696gitlab # [ 198.171035] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 501697gitlab # [ 198.304133] gitaly[892]: time="2026-10-08T16:11:48.494Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HZV6DSZM2MZ2PR17NCFJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.486" grpc.time_ms=7.461 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1698gitlab # [ 198.332649] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:48 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 681699gitlab # [ 198.382103] gitaly[892]: time="2026-10-08T16:11:48.571Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZXFNG59KASZN6CKM1YG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.561" pid=892 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1700gitlab # [ 198.382535] gitlab-workhorse[822]: time="2026-10-08T16:11:48Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091701gitlab # [ 198.382776] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:48 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 451702gitlab # [ 198.383439] gitaly[892]: time="2026-10-08T16:11:48.571Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZXFNG59KASZN6CKM1YG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.561" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1703gitlab # [ 198.384124] gitaly[892]: time="2026-10-08T16:11:48.572Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1161 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HZXFNG59KASZN6CKM1YG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:11:48.561" grpc.time_ms=10.99 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1704gitlab # [ 198.499742] gitaly[892]: time="2026-10-08T16:11:48.689Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:18.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:11:48.688" grpc.time_ms=0.82 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1705gitlab # [ 198.540673] gitaly[892]: time="2026-10-08T16:11:48.731Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-08T16:12:18.123" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:48.724" grpc.time_ms=6.863 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706gitlab # [ 198.566258] gitaly[892]: time="2026-10-08T16:11:48.751Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=619 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:11:58.130" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:48.740" grpc.time_ms=10.274 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707gitlab # [ 198.581345] gitaly[892]: time="2026-10-08T16:11:48.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:11:58.153" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:48.763" grpc.time_ms=5.89 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1708gitlab # [ 198.628370] gitaly[892]: time="2026-10-08T16:11:48.818Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-08T16:11:58.208" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:48.818" grpc.time_ms=0.216 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1709gitlab # [ 198.637451] gitaly[892]: time="2026-10-08T16:11:48.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-08T16:11:58.212" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:48.822" grpc.time_ms=4.93 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710gitlab # [ 198.666654] gitaly[892]: time="2026-10-08T16:11:48.857Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:48.856" grpc.time_ms=0.249 pid=892 span.kind=server system=grpc1711gitlab # [ 198.693682] gitaly[892]: time="2026-10-08T16:11:48.884Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:11:48.883" grpc.time_ms=0.247 pid=892 span.kind=server system=grpc1712gitlab # [ 198.711352] gitaly[892]: time="2026-10-08T16:11:48.901Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W diskcache=98779466-e628-45c6-818a-1a9b93ebe628 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-08T16:11:58.220" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:48.830" pid=892 ref=refs/keep-around/efd95633fb617e761aecae84202359f9c0f6b219 remote_ip="2001:db8:1::1" revision=efd95633fb617e761aecae84202359f9c0f6b219 span.kind=server system=grpc username=root1713gitlab # [ 198.721710] gitaly[892]: time="2026-10-08T16:11:48.912Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5310 command.oublock=8 command.real_time_ms=63 command.spawn_token_fork_ms=0 command.system_time_ms=25 command.user_time_ms=17 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-08T16:11:58.220" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:11:48.830" grpc.time_ms=71.507 pid=892 ref=refs/keep-around/efd95633fb617e761aecae84202359f9c0f6b219 remote_ip="2001:db8:1::1" revision=efd95633fb617e761aecae84202359f9c0f6b219 span.kind=server system=grpc username=root1714gitlab # [ 198.738403] gitaly[892]: time="2026-10-08T16:11:48.928Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:18.327" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:11:48.928" grpc.time_ms=0.574 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715gitlab # [ 198.953487] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4981716gitlab # [ 198.962811] nixbot[2612]: {"ts": "2026-10-08T16:11:49.152Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-efd95633fb61-0"}1717gitlab # [ 199.145233] nixbot[2612]: {"ts": "2026-10-08T16:11:49.335Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-efd95633fb61-0", "argv0": "bwrap"}1718gitlab # [ 199.219995] systemd[1]: Started Nix Daemon.1719gitlab # [ 199.287425] nix-daemon[2772]: accepted connection from pid 2767, user nixbot1720gitlab # [ 203.551627] nix-daemon[2772]: accepted connection from pid 2814, user nixbot1721gitlab # [ 203.570142] nix-daemon[2772]: accepted connection from pid 2767, user nixbot1722gitlab # [ 207.702363] nix-daemon[2772]: accepted connection from pid 2767, user nixbot1723gitlab # [ 207.798150] nix-daemon[2772]: accepted connection from pid 2863, user nixbot1724gitlab # [ 207.851155] gitaly[892]: time="2026-10-08T16:11:58.040Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J94R7B74T9BGEXXV23DB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:28.039" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:11:58.039" grpc.time_ms=0.666 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725gitlab # [ 207.901929] gitaly[892]: time="2026-10-08T16:11:58.092Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J94R7B74T9BGEXXV23DB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:08.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:58.081" grpc.time_ms=10.196 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726gitlab # [ 207.942420] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1541727gitlab # [ 207.980787] gitaly[892]: time="2026-10-08T16:11:58.171Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J99PGK0AM2ZB4GYZYT14 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:28.169" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:11:58.170" grpc.time_ms=0.689 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1728gitlab # [ 208.004990] gitaly[892]: time="2026-10-08T16:11:58.195Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J99PGK0AM2ZB4GYZYT14 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:08.109" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:11:58.189" grpc.time_ms=5.769 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1729gitlab # [ 208.039447] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:11:58 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 941730gitlab # [ 212.388636] nix-daemon[2772]: accepted connection from pid 2931, user nixbot1731gitlab # [ 212.535529] gitaly[892]: time="2026-10-08T16:12:02.724Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JDN9DXCRNAM7V71ZKBZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:32.023" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:02.723" grpc.time_ms=0.74 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1732gitlab # [ 212.701528] gitaly[892]: time="2026-10-08T16:12:02.891Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4E4JDN9DXCRNAM7V71ZKBZY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:12.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:02.881" grpc.time_ms=10.504 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1733gitlab # [ 212.828602] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 4161734gitlab # [ 212.928891] sidekiq-cluster[2487]: 2026-10-08T16:12:03.118Z pid=2487 tid=xsv INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2487, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>435609600}1735gitlab # [ 213.020806] nixbot[2612]: {"ts": "2026-10-08T16:12:03.210Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "efd95633fb617e761aecae84202359f9c0f6b219", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1736gitlab # [ 213.084756] gitaly[892]: time="2026-10-08T16:12:03.275Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4JE94H8Y29R89DRJB6GJP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.265" grpc.time_ms=9.4 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1737gitlab # [ 213.085845] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 391738gitlab # [ 213.094740] sidekiq-cluster[2487]: W, [2026-10-08T16:12:03.285138 #2487] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1739gitlab # [ 213.130960] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:03.321Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1740gitlab # [ 213.149557] gitaly[892]: time="2026-10-08T16:12:03.339Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JEAF54N0GANHK04YBN4Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.330" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1741gitlab # [ 213.150608] gitaly[892]: time="2026-10-08T16:12:03.340Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JEAF54N0GANHK04YBN4Y grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.330" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1742gitlab # [ 213.152599] gitlab-workhorse[822]: time="2026-10-08T16:12:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671743gitlab # [ 213.154154] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 611744gitlab # [ 213.155820] gitaly[892]: time="2026-10-08T16:12:03.340Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JEAF54N0GANHK04YBN4Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.330" grpc.time_ms=10.237 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1745gitlab # [ 213.262494] gitaly[892]: time="2026-10-08T16:12:03.452Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4JEEJBMG44AF0NBRVXA7Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.443" grpc.time_ms=8.953 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1746gitlab # [ 213.263311] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 431747gitlab # [ 213.303831] gitaly[892]: time="2026-10-08T16:12:03.494Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JEFZ3VS3FYGQTH8NHS9Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.488" pid=892 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1748gitlab # [ 213.304247] gitaly[892]: time="2026-10-08T16:12:03.494Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JEFZ3VS3FYGQTH8NHS9Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.488" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1749gitlab # [ 213.325151] gitaly[892]: time="2026-10-08T16:12:03.515Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4JEFZ3VS3FYGQTH8NHS9Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:03.488" grpc.time_ms=6.33 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 213.338260] gitlab-workhorse[822]: time="2026-10-08T16:12:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671751gitlab # [ 213.338776] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 731752gitlab # [ 214.763882] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:04.953Z","message":"GitLab reliable fetch activated!"}1753gitlab # [ 214.764614] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:04.953Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1754gitlab # [ 233.572240] postgres[3145]: [3145] ERROR: relation "table_without_models" does not exist1755gitlab # [ 233.572789] postgres[3145]: [3145] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1756gitlab # [ 235.941912] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:26.131Z","message":"Booted Rails 7.2.3.1 application in production environment"}1757gitlab # [ 235.943620] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:26.133Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1758gitlab # [ 235.944746] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:26.134Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1759gitlab # [ 235.945846] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:26.134Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1760gitlab # [ 235.946980] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:26.137Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1761gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 39.47 seconds)1762gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1763gitlab # [ 236.833076] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:27 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 381764gitlab # [ 236.906915] gitaly[892]: time="2026-10-08T16:12:27.097Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5GGFJ4337SJK89GN2WC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:27.084" grpc.time_ms=12.208 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1765gitlab # [ 236.935739] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:27 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1011766gitlab # Enumerating objects: 5, done.1767gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1768gitlab # Delta compression using up to 4 threads1769gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1770gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done.1771gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1772gitlab # [ 237.159283] gitaly[892]: time="2026-10-08T16:12:27.349Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-08T16:12:57.337" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-08T16:12:27.338" grpc.time_ms=11.32 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773gitlab # [ 237.177453] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.367Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7aa01b584d51b62b456ec264","created_at":"2026-10-08T16:11:37.355Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:37.379Z","job_size_bytes":2,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7aa01b584d51b62b456ec264: start","job_status":"start","queue_duration_s":49.987027,"scheduling_latency_s":49.987066}1774gitlab # [ 237.195454] gitaly[892]: time="2026-10-08T16:12:27.385Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE duration_ms=101ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/allowed"1775gitlab # [ 237.236840] gitaly[892]: time="2026-10-08T16:12:27.427Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE duration_ms=38ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/pre_receive"1776gitlab # [ 237.237505] gitaly[892]: time="2026-10-08T16:12:27.427Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5309 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:27.283" grpc.time_ms=144.588 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1777gitlab # [ 237.284590] gitaly[892]: time="2026-10-08T16:12:27.475Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4779 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:27.474" grpc.time_ms=0.41 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1778gitlab # [ 237.328373] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.518Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"7aa01b584d51b62b456ec264","created_at":"2026-10-08T16:11:37.355Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:37.379Z","job_size_bytes":2,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-7aa01b584d51b62b456ec264: done: 0.151686 sec","job_status":"done","queue_duration_s":49.987027,"scheduling_latency_s":49.987066,"redis_calls":25,"redis_duration_s":0.018661999999999998,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002809,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.014842,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06475851,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.151686,"completed_at":"2026-10-08T16:12:27.518Z","load_balancing_strategy":"primary","db_duration_s":0.042017,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1779gitlab # [ 237.329986] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.520Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0d5020d1566b1ee9f333f2cc","created_at":"2026-10-08T16:11:37.387Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:37.390Z","job_size_bytes":2,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0d5020d1566b1ee9f333f2cc: start","job_status":"start","queue_duration_s":50.129631,"scheduling_latency_s":50.129647}1780gitlab # [ 237.388519] gitaly[892]: time="2026-10-08T16:12:27.578Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4778 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:27.578" grpc.time_ms=0.354 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 237.406536] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.596Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0d5020d1566b1ee9f333f2cc","created_at":"2026-10-08T16:11:37.387Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:37.390Z","job_size_bytes":2,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0d5020d1566b1ee9f333f2cc: done: 0.075981 sec","job_status":"done","queue_duration_s":50.129631,"scheduling_latency_s":50.129647,"redis_calls":14,"redis_duration_s":0.0027919999999999998,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00039,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.054791043000000005,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.075981,"completed_at":"2026-10-08T16:12:27.596Z","load_balancing_strategy":"primary","db_duration_s":0.019856,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1782gitlab # [ 237.447573] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.598Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"de82e53db3adaec43ed709fe","created_at":"2026-10-08T16:11:37.967Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:37.977Z","job_size_bytes":5,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-de82e53db3adaec43ed709fe: start","job_status":"start","queue_duration_s":49.621279,"scheduling_latency_s":49.62131}1783gitlab # [ 237.463411] gitaly[892]: time="2026-10-08T16:12:27.623Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:27.622" grpc.time_ms=0.383 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1784gitlab # [ 237.534100] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.724Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"de82e53db3adaec43ed709fe","created_at":"2026-10-08T16:11:37.967Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:37.977Z","job_size_bytes":5,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-de82e53db3adaec43ed709fe: done: 0.125948 sec","job_status":"done","queue_duration_s":49.621279,"scheduling_latency_s":49.62131,"redis_calls":12,"redis_duration_s":0.001882,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001024,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.102303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212597,"duration_s":0.125948,"completed_at":"2026-10-08T16:12:27.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016544,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1785gitlab # [ 237.555684] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.725Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"92ca2beeddff1de3a5a946f7","created_at":"2026-10-08T16:11:38.007Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:38.012Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-92ca2beeddff1de3a5a946f7: start","job_status":"start","queue_duration_s":49.712312,"scheduling_latency_s":49.712326}1786gitlab # [ 237.556446] gitaly[892]: time="2026-10-08T16:12:27.742Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE duration_ms=58ns method=POST pid=892 status=200 url="http://unix/api/v4/internal/post_receive"1787gitlab # [ 237.556923] gitaly[892]: time="2026-10-08T16:12:27.742Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4803 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:27.683" grpc.time_ms=59.679 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1788gitlab # [ 237.607346] gitaly[892]: time="2026-10-08T16:12:27.797Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE diskcache=26468f4c-52a9-4256-9692-299d2d853179 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:27.203" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1789gitlab # [ 237.607815] gitaly[892]: time="2026-10-08T16:12:27.797Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=308 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13596 command.oublock=32 command.real_time_ms=585 command.spawn_token_fork_ms=1 command.system_time_ms=216 command.user_time_ms=92 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:27.203" grpc.time_ms=594.446 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1790gitlab # [ 237.608598] gitlab-workhorse[822]: time="2026-10-08T16:12:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521791gitlab # [ 237.609069] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:27 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6461792gitlab # To http://gitlab/root/test-flake.git1793gitlab # efd9563..8f5fa13 master -> master1794gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.90 seconds)1795gitlab: must succeed: git -C /tmp/test-flake rev-parse master1796gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1797gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58'1798gitlab # [ 237.659630] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.849Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"92ca2beeddff1de3a5a946f7","created_at":"2026-10-08T16:11:38.007Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:38.012Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-92ca2beeddff1de3a5a946f7: done: 0.124536 sec","job_status":"done","queue_duration_s":49.712312,"scheduling_latency_s":49.712326,"redis_calls":11,"redis_duration_s":0.001879,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000405,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.101,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.101,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000224051,"duration_s":0.124536,"completed_at":"2026-10-08T16:12:27.849Z","load_balancing_strategy":"primary","db_duration_s":0.038481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1799gitlab # [ 237.660711] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.851Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3bf89db91bafa97dea4954c5","created_at":"2026-10-08T16:11:38.016Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:38.021Z","job_size_bytes":89,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3bf89db91bafa97dea4954c5: start","job_status":"start","queue_duration_s":49.829702,"scheduling_latency_s":49.829717}1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58', in 0.08 seconds)1801gitlab # [ 237.684737] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.874Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3bf89db91bafa97dea4954c5","created_at":"2026-10-08T16:11:38.016Z","trace_propagation_headers":{"sentry-trace":"d8251594e655411093abe911753cee21-a683fad40d834883","baggage":"sentry-trace_id=d8251594e655411093abe911753cee21,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HM85YQWVRK3CVTH5J62H","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:38.021Z","job_size_bytes":89,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3bf89db91bafa97dea4954c5: done: 0.023771 sec","job_status":"done","queue_duration_s":49.829702,"scheduling_latency_s":49.829717,"redis_calls":11,"redis_duration_s":0.00158,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000406,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000896,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000278,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231035,"duration_s":0.023771,"completed_at":"2026-10-08T16:12:27.874Z","load_balancing_strategy":"primary","db_duration_s":0.002801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1802gitlab # [ 237.731444] nixbot[2612]: {"ts": "2026-10-08T16:12:27.895Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48194 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1\" 200"}1803gitlab # [ 237.732067] gitaly[892]: time="2026-10-08T16:12:27.909Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:37.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:27.903" grpc.time_ms=6.056 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 237.732622] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.876Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 efd95633fb617e761aecae84202359f9c0f6b219 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e43f8dcf50a557ff01253632","created_at":"2026-10-08T16:11:44.821Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-6cd766f50978468c","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:44.824Z","job_size_bytes":185,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e43f8dcf50a557ff01253632: start","job_status":"start","queue_duration_s":43.051032,"scheduling_latency_s":43.051049}1805gitlab # [ 237.742428] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:27.885Z","message":"changes: \"0000000000000000000000000000000000000000 efd95633fb617e761aecae84202359f9c0f6b219 refs/heads/master\\n\""}1806gitlab # [ 237.744721] gitaly[892]: time="2026-10-08T16:12:27.922Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:12:37.012" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:27.912" grpc.time_ms=10.073 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 237.766063] gitaly[892]: time="2026-10-08T16:12:27.956Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-08T16:12:37.048" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:27.949" grpc.time_ms=7.299 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 237.789867] gitaly[892]: time="2026-10-08T16:12:27.980Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3931 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:27.980" grpc.time_ms=0.233 pid=892 span.kind=server system=grpc1809gitlab # [ 237.816754] gitaly[892]: time="2026-10-08T16:12:28.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:28.006" grpc.time_ms=0.543 pid=892 span.kind=server system=grpc1810gitlab # [ 237.830920] gitaly[892]: time="2026-10-08T16:12:28.021Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 diskcache=4f2d5aaf-8e04-48a2-af92-f108fc3bf578 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-08T16:12:37.062" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:27.962" pid=892 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1811gitlab # [ 237.831287] gitaly[892]: time="2026-10-08T16:12:28.021Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=41 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4740 command.oublock=8 command.real_time_ms=47 command.spawn_token_fork_ms=0 command.system_time_ms=29 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-08T16:12:37.062" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:27.962" grpc.time_ms=58.988 pid=892 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1812gitlab # [ 237.841508] gitaly[892]: time="2026-10-08T16:12:28.032Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-08T16:12:38.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:28.031" grpc.time_ms=0.125 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 237.849960] gitaly[892]: time="2026-10-08T16:12:28.040Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-08T16:12:38.003" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:28.034" grpc.time_ms=6.242 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 237.902784] gitaly[892]: time="2026-10-08T16:12:28.093Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=338 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-08T16:12:58.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:28.087" grpc.time_ms=5.646 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 237.922621] gitaly[892]: time="2026-10-08T16:12:28.112Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-08T16:12:38.081" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:28.112" grpc.time_ms=0.249 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 237.938505] gitaly[892]: time="2026-10-08T16:12:28.128Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-08T16:12:38.092" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-08T16:12:28.122" grpc.time_ms=6.023 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1817gitlab # [ 237.972451] gitaly[892]: time="2026-10-08T16:12:28.162Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:38.126" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:28.156" grpc.time_ms=5.823 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 237.990587] gitaly[892]: time="2026-10-08T16:12:28.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:38.144" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:28.175" grpc.time_ms=5.758 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 238.027608] gitaly[892]: time="2026-10-08T16:12:28.217Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=964 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-08T16:12:58.205" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:28.205" grpc.time_ms=12.252 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 238.385920] gitaly[892]: time="2026-10-08T16:12:28.576Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-08T16:12:38.004" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:28.574" grpc.time_ms=1.275 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 238.453930] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:28.642Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 efd95633fb617e761aecae84202359f9c0f6b219 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"e43f8dcf50a557ff01253632","created_at":"2026-10-08T16:11:44.821Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-6cd766f50978468c","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:11:44.824Z","job_size_bytes":185,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-e43f8dcf50a557ff01253632: done: 0.766904 sec","job_status":"done","queue_duration_s":43.051032,"scheduling_latency_s":43.051049,"gitaly_calls":13,"gitaly_duration_s":0.193593,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.060495,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.003323,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005549,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001458,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002613,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.011029,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.036523,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.178,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.193,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.469765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00036513,"exclusive_lock_hold_duration_s":0.018440332,"duration_s":0.766904,"completed_at":"2026-10-08T16:12:28.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074704,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1822gitlab # [ 238.527618] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:28.645Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fcc701486caa478f71db789b","created_at":"2026-10-08T16:11:48.939Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:48.960Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fcc701486caa478f71db789b: start","job_status":"start","queue_duration_s":39.684427,"scheduling_latency_s":39.684459}1823gitlab # [ 238.550634] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:28.740Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"fcc701486caa478f71db789b","created_at":"2026-10-08T16:11:48.939Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:48.960Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-fcc701486caa478f71db789b: done: 0.095434 sec","job_status":"done","queue_duration_s":39.684427,"scheduling_latency_s":39.684459,"redis_calls":16,"redis_duration_s":0.004446,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002128,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000809,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000285511,"duration_s":0.095434,"completed_at":"2026-10-08T16:12:28.740Z","load_balancing_strategy":"primary","db_duration_s":0.030982,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1824gitlab # [ 238.551929] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:28.742Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5d6fe9bc1d84b3f9eff347da","created_at":"2026-10-08T16:11:48.962Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:48.965Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5d6fe9bc1d84b3f9eff347da: start","job_status":"start","queue_duration_s":39.776542,"scheduling_latency_s":39.776556}1825gitlab # [ 238.620834] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:28.810Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"5d6fe9bc1d84b3f9eff347da","created_at":"2026-10-08T16:11:48.962Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:48.965Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-5d6fe9bc1d84b3f9eff347da: done: 0.068941 sec","job_status":"done","queue_duration_s":39.776542,"scheduling_latency_s":39.776556,"redis_calls":21,"redis_duration_s":0.003665,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001941,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000781,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000201981,"duration_s":0.068941,"completed_at":"2026-10-08T16:12:28.810Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028083,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826gitlab # [ 238.622530] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:28.811Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"03990517f210a8c146c9733d","created_at":"2026-10-08T16:11:49.125Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:49.130Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-03990517f210a8c146c9733d: start","job_status":"start","queue_duration_s":39.681211,"scheduling_latency_s":39.681225}1827gitlab # [ 238.720589] gitaly[892]: time="2026-10-08T16:12:28.910Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:28.910" grpc.time_ms=0.264 pid=892 span.kind=server system=grpc1828gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58'1829gitlab # [ 238.757120] gitaly[892]: time="2026-10-08T16:12:28.947Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:28.947" grpc.time_ms=0.332 pid=892 span.kind=server system=grpc1830gitlab # [ 238.758711] nixbot[2612]: {"ts": "2026-10-08T16:12:28.947Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48206 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1\" 200"}1831gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58', in 0.04 seconds)1832gitlab # [ 238.796522] gitaly[892]: time="2026-10-08T16:12:28.986Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:28.986" grpc.time_ms=0.383 pid=892 span.kind=server system=grpc1833gitlab # [ 238.813985] gitaly[892]: time="2026-10-08T16:12:29.004Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W diskcache=4a136af7-7cfb-48e6-9e47-f496232f595b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:12:58.883" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:28.884" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834gitlab # [ 238.823699] gitaly[892]: time="2026-10-08T16:12:29.004Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=108 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7236 command.oublock=0 command.real_time_ms=113 command.spawn_token_fork_ms=0 command.system_time_ms=64 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:12:58.883" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:28.884" grpc.time_ms=120.473 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835gitlab # [ 238.948221] gitaly[892]: time="2026-10-08T16:12:29.137Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:12:59.136" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.136" grpc.time_ms=1.108 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab # [ 238.974554] gitaly[892]: time="2026-10-08T16:12:29.164Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:59.163" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.163" grpc.time_ms=0.738 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 238.990429] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.180Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"03990517f210a8c146c9733d","created_at":"2026-10-08T16:11:49.125Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:49.130Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2487,"job_status":"rescheduled","message":"PipelineProcessWorker JID-03990517f210a8c146c9733d: rescheduled"}1838gitlab # [ 239.002800] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.192Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"03990517f210a8c146c9733d","created_at":"2026-10-08T16:11:49.125Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-6c58edb17b694409","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:11:49.130Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-03990517f210a8c146c9733d: done: 0.380626 sec","job_status":"done","queue_duration_s":39.681211,"scheduling_latency_s":39.681225,"gitaly_calls":3,"gitaly_duration_s":0.128676,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018993,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000644,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000913,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.006585,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003173,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15579,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004855,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000286,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000288,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001605,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.013,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.191749,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.334306456,"duration_s":0.380626,"completed_at":"2026-10-08T16:12:29.192Z","load_balancing_strategy":"primary","db_duration_s":0.046525,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1839gitlab # [ 239.048583] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.194Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","efd95633fb617e761aecae84202359f9c0f6b219 8f5fa1331c0ec995c36a7ded702dd06b50d31b58 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"296282121e03bdd58737d0de","created_at":"2026-10-08T16:12:27.709Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-e2ba813eadf64388","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:12:27.712Z","job_size_bytes":185,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-296282121e03bdd58737d0de: start","job_status":"start","queue_duration_s":1.482033,"scheduling_latency_s":1.482065}1840gitlab # [ 239.048757] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.208Z","message":"changes: \"efd95633fb617e761aecae84202359f9c0f6b219 8f5fa1331c0ec995c36a7ded702dd06b50d31b58 refs/heads/master\\n\""}1841gitlab # [ 239.049234] gitaly[892]: time="2026-10-08T16:12:29.232Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:39.196" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:29.227" grpc.time_ms=5.262 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 239.056622] gitaly[892]: time="2026-10-08T16:12:29.242Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-08T16:12:39.206" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:29.237" grpc.time_ms=5.525 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 239.102681] gitaly[892]: time="2026-10-08T16:12:29.269Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-08T16:12:39.231" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:29.261" grpc.time_ms=7.124 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1844gitlab # [ 239.103548] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.247Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"2b0611c4dd69d75da9d4d4ec","created_at":"2026-10-08T16:12:29.245Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"b1acc325d4a24fd8ef280f3f","job_size_bytes":46,"pid":2487,"job_status":"deduplicated","message":"ProjectCacheWorker JID-2b0611c4dd69d75da9d4d4ec: deduplicated: until executing","deduplication.type":"until executing"}1845gitlab # [ 239.104219] gitaly[892]: time="2026-10-08T16:12:29.278Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-08T16:12:59.273" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.273" grpc.time_ms=5.433 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1846gitlab # [ 239.107671] gitaly[892]: time="2026-10-08T16:12:29.289Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-08T16:12:39.255" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-08T16:12:29.286" grpc.time_ms=3.418 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1847gitlab # [ 239.119662] gitaly[892]: time="2026-10-08T16:12:29.300Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:39.264" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:29.294" grpc.time_ms=6.109 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab # [ 239.211436] gitaly[892]: time="2026-10-08T16:12:29.401Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-08T16:12:39.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.400" grpc.time_ms=0.893 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 239.237268] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.427Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","efd95633fb617e761aecae84202359f9c0f6b219 8f5fa1331c0ec995c36a7ded702dd06b50d31b58 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"296282121e03bdd58737d0de","created_at":"2026-10-08T16:12:27.709Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-e2ba813eadf64388","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-08T16:12:27.712Z","job_size_bytes":185,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-296282121e03bdd58737d0de: done: 0.232291 sec","job_status":"done","queue_duration_s":1.482033,"scheduling_latency_s":1.482065,"gitaly_calls":7,"gitaly_duration_s":0.048948,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.062679,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001729,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000672,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002274,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006877,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.051127,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.062,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.062,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000727466,"exclusive_lock_hold_duration_s":0.015484929,"duration_s":0.232291,"completed_at":"2026-10-08T16:12:29.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022383,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1850gitlab # [ 239.241700] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.429Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b1acc325d4a24fd8ef280f3f","created_at":"2026-10-08T16:12:27.924Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:27.935Z","job_size_bytes":46,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b1acc325d4a24fd8ef280f3f: start","job_status":"start","queue_duration_s":1.493281,"scheduling_latency_s":1.493311}1851gitlab # [ 239.273541] gitaly[892]: time="2026-10-08T16:12:29.463Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-08T22:12:29.461" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:29.461" grpc.time_ms=2.087 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 239.285700] gitaly[892]: time="2026-10-08T16:12:29.476Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-08T16:12:59.469" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.470" grpc.time_ms=5.878 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 239.305776] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.495Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"b1acc325d4a24fd8ef280f3f","created_at":"2026-10-08T16:12:27.924Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:27.935Z","job_size_bytes":46,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b1acc325d4a24fd8ef280f3f: done: 0.066975 sec","job_status":"done","queue_duration_s":1.493281,"scheduling_latency_s":1.493311,"gitaly_calls":2,"gitaly_duration_s":0.011624,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006502,"redis_read_bytes":69,"redis_write_bytes":4880,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.0012,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.00056,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2113,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001338,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002745,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000256736,"duration_s":0.066975,"completed_at":"2026-10-08T16:12:29.495Z","load_balancing_strategy":"primary","db_duration_s":0.011263,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1854gitlab # [ 239.359729] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.497Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5ddac3b9b6bcfacd2e5547e4","created_at":"2026-10-08T16:12:27.944Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:27.946Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5ddac3b9b6bcfacd2e5547e4: start","job_status":"start","queue_duration_s":1.550668,"scheduling_latency_s":1.550682}1855gitlab # [ 239.360432] gitaly[892]: time="2026-10-08T16:12:29.538Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 diskcache=46c55eea-60df-48b0-a03b-1d98badceaf0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-08T22:12:29.513" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.513" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856gitlab # [ 239.361098] gitaly[892]: time="2026-10-08T16:12:29.538Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1282 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-08T22:12:29.513" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.513" grpc.time_ms=24.743 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857gitlab # [ 239.373836] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.564Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5ddac3b9b6bcfacd2e5547e4","created_at":"2026-10-08T16:12:27.944Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:27.946Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5ddac3b9b6bcfacd2e5547e4: done: 0.066904 sec","job_status":"done","queue_duration_s":1.550668,"scheduling_latency_s":1.550682,"gitaly_calls":1,"gitaly_duration_s":0.026639,"redis_calls":15,"redis_duration_s":0.003316,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000539,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.050685493,"duration_s":0.066904,"completed_at":"2026-10-08T16:12:29.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014521,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 239.424880] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.565Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a0a1e1ee5b392223bd94a9f9","created_at":"2026-10-08T16:12:28.028Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.030Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a0a1e1ee5b392223bd94a9f9: start","job_status":"start","queue_duration_s":1.535104,"scheduling_latency_s":1.535118}1859gitlab # [ 239.425659] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.593Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a0a1e1ee5b392223bd94a9f9","created_at":"2026-10-08T16:12:28.028Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.030Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a0a1e1ee5b392223bd94a9f9: done: 0.028372 sec","job_status":"done","queue_duration_s":1.535104,"scheduling_latency_s":1.535118,"gitaly_calls":1,"gitaly_duration_s":0.0068,"redis_calls":16,"redis_duration_s":0.003117,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000207,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000822,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001203,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028372,"completed_at":"2026-10-08T16:12:29.593Z","load_balancing_strategy":"primary","db_duration_s":0.002438,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1860gitlab # [ 239.481093] gitaly[892]: time="2026-10-08T16:12:29.587Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-08T16:12:59.582" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.582" grpc.time_ms=5.171 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861gitlab # [ 239.481964] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:29.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0045a449a0bde6d7512d8e41","created_at":"2026-10-08T16:12:28.457Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:110ddf59d91ba558da1c69ddc969c7d5c2db3fbebaf21a4a3137be7c4f427c2f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.462Z","job_size_bytes":467,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0045a449a0bde6d7512d8e41: start","job_status":"start","queue_duration_s":1.132103,"scheduling_latency_s":1.132117}1862gitlab # [ 239.482640] gitaly[892]: time="2026-10-08T16:12:29.611Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:12:59.610" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.610" grpc.time_ms=0.469 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 239.522148] gitaly[892]: time="2026-10-08T16:12:29.617Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-08T16:12:39.042" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:29.613" grpc.time_ms=4.657 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 239.522922] gitaly[892]: time="2026-10-08T16:12:29.695Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:12:59.694" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.695" grpc.time_ms=0.862 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865gitlab # [ 239.523569] gitaly[892]: time="2026-10-08T16:12:29.699Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=26 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-08T16:12:59.697" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:29.698" grpc.time_ms=1.597 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1866gitlab # [ 239.561419] gitaly[892]: time="2026-10-08T16:12:29.751Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:39.175" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:29.746" grpc.time_ms=5.689 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1867gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58'1868gitlab # [ 239.816281] nixbot[2612]: {"ts": "2026-10-08T16:12:30.005Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48208 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1\" 200"}1869gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58', in 0.05 seconds)1870gitlab # [ 239.975068] gitaly[892]: time="2026-10-08T16:12:30.164Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-08T16:13:00.146" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:30.147" grpc.time_ms=17.347 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 240.019803] gitaly[892]: time="2026-10-08T16:12:30.210Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4HVVK54WMJQ0NVE6M3TY2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-08T16:13:00.201" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:30.201" grpc.time_ms=8.537 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 240.064651] sidekiq-cluster[2487]: {"severity":"WARN","time":"2026-10-08T16:12:30.255Z","class":"CreatePipelineWorker","correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"efd95633fb617e761aecae84202359f9c0f6b219","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"efd95633fb617e761aecae84202359f9c0f6b219","ref":"refs/heads/master"},"retry":0}1873gitlab # [ 240.069794] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.259Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"0045a449a0bde6d7512d8e41","created_at":"2026-10-08T16:12:28.457Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:110ddf59d91ba558da1c69ddc969c7d5c2db3fbebaf21a4a3137be7c4f427c2f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.462Z","job_size_bytes":467,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-0045a449a0bde6d7512d8e41: done: 0.66523 sec","job_status":"done","queue_duration_s":1.132103,"scheduling_latency_s":1.132117,"gitaly_calls":7,"gitaly_duration_s":0.10873,"redis_calls":51,"redis_duration_s":0.007339,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000493,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003294,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001574,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.513783,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028579,"duration_s":0.66523,"completed_at":"2026-10-08T16:12:30.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033758,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1874gitlab # [ 240.125954] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.261Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"58345669-7aed-4827-888b-bc9c001b438d\"}"],"class":"WebHookWorker","jid":"f02ab36c00595de207cf4b7f","created_at":"2026-10-08T16:12:28.551Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:72cc5ff03773958d03fcf2d971898c292a70cf3b22afb080fd677d3010b968b1","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.556Z","job_size_bytes":1751,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-f02ab36c00595de207cf4b7f: start","job_status":"start","queue_duration_s":1.704846,"scheduling_latency_s":1.70486}1875gitlab # [ 240.182836] nixbot[2612]: {"ts": "2026-10-08T16:12:30.373Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "6f9ea1d2-7536-49aa-9750-476cba84e249", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "efd95633fb617e761aecae84202359f9c0f6b219", "pr": null}1876gitlab # [ 240.187378] nixbot[2612]: {"ts": "2026-10-08T16:12:30.377Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48216 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1877gitlab # [ 240.213104] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.402Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"58345669-7aed-4827-888b-bc9c001b438d\"}"],"class":"WebHookWorker","jid":"f02ab36c00595de207cf4b7f","created_at":"2026-10-08T16:12:28.551Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-061f6d8f5f224ffe","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:72cc5ff03773958d03fcf2d971898c292a70cf3b22afb080fd677d3010b968b1","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.556Z","job_size_bytes":1751,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-f02ab36c00595de207cf4b7f: done: 0.141217 sec","job_status":"done","queue_duration_s":1.704846,"scheduling_latency_s":1.70486,"redis_calls":19,"redis_duration_s":0.004506,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000975,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000508,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002163,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03842946599999664,"cpu_s":0.084654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000487213,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.141217,"completed_at":"2026-10-08T16:12:30.402Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00291,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1878gitlab # [ 240.235200] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.405Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"582d6b1022ae12d3855e706f","created_at":"2026-10-08T16:12:28.875Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.877Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-582d6b1022ae12d3855e706f: start","job_status":"start","queue_duration_s":1.527279,"scheduling_latency_s":1.527318}1879gitlab # [ 240.252049] gitaly[892]: time="2026-10-08T16:12:30.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K8SYNM47GW9T39RNS7PN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.436" grpc.time_ms=5.428 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1880gitlab # [ 240.253124] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 441881gitlab # [ 240.298684] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"582d6b1022ae12d3855e706f","created_at":"2026-10-08T16:12:28.875Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:28.877Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-582d6b1022ae12d3855e706f: done: 0.083465 sec","job_status":"done","queue_duration_s":1.527279,"scheduling_latency_s":1.527318,"redis_calls":10,"redis_duration_s":0.00229,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000412,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000255619,"duration_s":0.083465,"completed_at":"2026-10-08T16:12:30.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011685,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1882gitlab # [ 240.340259] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.530Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3728aa3aa83a6c065a8fd5b4","created_at":"2026-10-08T16:12:29.008Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.012Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3728aa3aa83a6c065a8fd5b4: start","job_status":"start","queue_duration_s":1.517864,"scheduling_latency_s":1.517909}1883gitlab # [ 240.378065] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.567Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3728aa3aa83a6c065a8fd5b4","created_at":"2026-10-08T16:12:29.008Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.012Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3728aa3aa83a6c065a8fd5b4: done: 0.037949 sec","job_status":"done","queue_duration_s":1.517864,"scheduling_latency_s":1.517909,"redis_calls":10,"redis_duration_s":0.002138,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001293,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000322667,"duration_s":0.037949,"completed_at":"2026-10-08T16:12:30.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1884gitlab # [ 240.379730] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c64b5881a6d8d24d84149bda","created_at":"2026-10-08T16:12:29.019Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.024Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c64b5881a6d8d24d84149bda: start","job_status":"start","queue_duration_s":1.546087,"scheduling_latency_s":1.546102}1885gitlab # [ 240.397899] gitaly[892]: time="2026-10-08T16:12:30.587Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K8WDXNBG8TY57NZFZ83D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.566" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1886gitlab # [ 240.401733] gitaly[892]: time="2026-10-08T16:12:30.587Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K8WDXNBG8TY57NZFZ83D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.566" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 240.448838] gitlab-workhorse[822]: time="2026-10-08T16:12:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671888gitlab # [ 240.449666] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1111889gitlab # [ 240.450213] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c64b5881a6d8d24d84149bda","created_at":"2026-10-08T16:12:29.019Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.024Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c64b5881a6d8d24d84149bda: done: 0.031102 sec","job_status":"done","queue_duration_s":1.546087,"scheduling_latency_s":1.546102,"redis_calls":10,"redis_duration_s":0.002546,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00042,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001579,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000547,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000274895,"duration_s":0.031102,"completed_at":"2026-10-08T16:12:30.601Z","load_balancing_strategy":"primary","db_duration_s":0.008489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1890gitlab # [ 240.455344] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.606Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"6d157c201df0ac621aa4fdde","created_at":"2026-10-08T16:12:29.033Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.036Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6d157c201df0ac621aa4fdde: start","job_status":"start","queue_duration_s":1.570182,"scheduling_latency_s":1.570196}1891gitlab # [ 240.499354] gitaly[892]: time="2026-10-08T16:12:30.588Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K8WDXNBG8TY57NZFZ83D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.566" grpc.time_ms=21.322 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1892gitlab # [ 240.500032] gitlab-workhorse[822]: time="2026-10-08T16:12:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371893gitlab # [ 240.500452] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 651894gitlab # [ 240.501098] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.651Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"6d157c201df0ac621aa4fdde","created_at":"2026-10-08T16:12:29.033Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.036Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-6d157c201df0ac621aa4fdde: done: 0.044951 sec","job_status":"done","queue_duration_s":1.570182,"scheduling_latency_s":1.570196,"redis_calls":13,"redis_duration_s":0.002999,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001146,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000451,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000249473,"duration_s":0.044951,"completed_at":"2026-10-08T16:12:30.651Z","load_balancing_strategy":"primary","db_duration_s":0.006049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1895gitlab # [ 240.540764] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b490604253cf338344f13276","created_at":"2026-10-08T16:12:29.036Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.038Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b490604253cf338344f13276: start","job_status":"start","queue_duration_s":1.613849,"scheduling_latency_s":1.613864}1896gitlab # [ 240.541493] gitaly[892]: time="2026-10-08T16:12:30.656Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K8ZZV0FBE1BNH51SHB7K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.644" pid=892 remote_ip="2001:db8:1::1" request_sha=f18f5d53ca129b044032aae17076ec1fe27fc08d response_bytes=337 span.kind=server system=grpc1897gitlab # [ 240.582227] nixbot[2612]: {"ts": "2026-10-08T16:12:30.717Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1898gitlab # [ 240.582873] nixbot[2612]: {"ts": "2026-10-08T16:12:30.718Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "efd95633fb617e761aecae84202359f9c0f6b219"}1899gitlab # [ 240.583505] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b490604253cf338344f13276","created_at":"2026-10-08T16:12:29.036Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.038Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b490604253cf338344f13276: done: 0.02109 sec","job_status":"done","queue_duration_s":1.613849,"scheduling_latency_s":1.613864,"redis_calls":10,"redis_duration_s":0.0014680000000000001,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220419,"duration_s":0.02109,"completed_at":"2026-10-08T16:12:30.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1900gitlab # [ 240.591670] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.674Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7e3e3839825089d4498bdf37","created_at":"2026-10-08T16:12:29.038Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.041Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7e3e3839825089d4498bdf37: start","job_status":"start","queue_duration_s":1.63293,"scheduling_latency_s":1.632943}1901gitlab # [ 240.637597] gitaly[892]: time="2026-10-08T16:12:30.656Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K8ZZV0FBE1BNH51SHB7K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.644" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1902gitlab # [ 240.638474] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.694Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7e3e3839825089d4498bdf37","created_at":"2026-10-08T16:12:29.038Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.041Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7e3e3839825089d4498bdf37: done: 0.020484 sec","job_status":"done","queue_duration_s":1.63293,"scheduling_latency_s":1.632943,"redis_calls":11,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000244724,"duration_s":0.020484,"completed_at":"2026-10-08T16:12:30.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002396,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1903gitlab # [ 240.678776] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.696Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"41c2437fc81cbbe56f7abecc","created_at":"2026-10-08T16:12:29.099Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.104Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-41c2437fc81cbbe56f7abecc: start","job_status":"start","queue_duration_s":1.591969,"scheduling_latency_s":1.591983}1904gitlab # [ 240.679603] gitaly[892]: time="2026-10-08T16:12:30.656Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1196 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K8ZZV0FBE1BNH51SHB7K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:30.644" grpc.time_ms=12.43 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1905gitlab # [ 240.684147] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1231906gitlab # [ 240.686435] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.790Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"41c2437fc81cbbe56f7abecc","created_at":"2026-10-08T16:12:29.099Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.104Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-41c2437fc81cbbe56f7abecc: done: 0.094007 sec","job_status":"done","queue_duration_s":1.591969,"scheduling_latency_s":1.591983,"redis_calls":10,"redis_duration_s":0.002561,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000387,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000838,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.071,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.068,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000454806,"duration_s":0.094007,"completed_at":"2026-10-08T16:12:30.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.07136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1907gitlab # [ 240.757047] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.791Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b7db7fe77392fb01e02e138c","created_at":"2026-10-08T16:12:29.104Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.107Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b7db7fe77392fb01e02e138c: start","job_status":"start","queue_duration_s":1.683424,"scheduling_latency_s":1.683439}1908gitlab # [ 240.757633] gitaly[892]: time="2026-10-08T16:12:30.761Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K948T6ET79Y5R5YC3GAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:00.160" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:30.760" grpc.time_ms=0.456 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58'1910gitlab # [ 240.758789] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.815Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b7db7fe77392fb01e02e138c","created_at":"2026-10-08T16:12:29.104Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.107Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b7db7fe77392fb01e02e138c: done: 0.024707 sec","job_status":"done","queue_duration_s":1.683424,"scheduling_latency_s":1.683439,"redis_calls":10,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000273,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220419,"duration_s":0.024707,"completed_at":"2026-10-08T16:12:30.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1911gitlab # [ 240.825517] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.816Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3ba9c92fa7f8bc9639c4e6a8","created_at":"2026-10-08T16:12:29.112Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.114Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3ba9c92fa7f8bc9639c4e6a8: start","job_status":"start","queue_duration_s":1.702131,"scheduling_latency_s":1.702145}1912gitlab # [ 240.825800] gitaly[892]: time="2026-10-08T16:12:30.819Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K948T6ET79Y5R5YC3GAH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:40.243" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:30.813" grpc.time_ms=5.531 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab # [ 240.826398] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1251914gitlab # [ 240.827091] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.843Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3ba9c92fa7f8bc9639c4e6a8","created_at":"2026-10-08T16:12:29.112Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.114Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3ba9c92fa7f8bc9639c4e6a8: done: 0.026937 sec","job_status":"done","queue_duration_s":1.702131,"scheduling_latency_s":1.702145,"redis_calls":10,"redis_duration_s":0.001344,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022014,"duration_s":0.026937,"completed_at":"2026-10-08T16:12:30.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1915gitlab # [ 240.877959] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.845Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"077bee839dc0b4450f968ee6","created_at":"2026-10-08T16:12:29.115Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.117Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-077bee839dc0b4450f968ee6: start","job_status":"start","queue_duration_s":1.727292,"scheduling_latency_s":1.727309}1916gitlab # [ 240.878953] gitaly[892]: time="2026-10-08T16:12:30.890Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9873SPM29AVVP6Q8Q80 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:00.188" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:30.889" grpc.time_ms=0.785 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1917gitlab # [ 240.886951] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.859Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"077bee839dc0b4450f968ee6","created_at":"2026-10-08T16:12:29.115Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.117Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-077bee839dc0b4450f968ee6: done: 0.014565 sec","job_status":"done","queue_duration_s":1.727292,"scheduling_latency_s":1.727309,"redis_calls":10,"redis_duration_s":0.001437,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213435,"duration_s":0.014565,"completed_at":"2026-10-08T16:12:30.859Z","load_balancing_strategy":"primary","db_duration_s":0.001536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1918gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58', in 0.15 seconds)1919gitlab # [ 240.943740] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.860Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1cb2166de57d0caa45b8511b","created_at":"2026-10-08T16:12:29.118Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.120Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1cb2166de57d0caa45b8511b: start","job_status":"start","queue_duration_s":1.739842,"scheduling_latency_s":1.739856}1920gitlab # [ 240.944634] gitaly[892]: time="2026-10-08T16:12:30.946Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K9873SPM29AVVP6Q8Q80 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:40.110" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:30.940" grpc.time_ms=6.16 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 240.984354] gitaly[892]: time="2026-10-08T16:12:30.997Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:30.996" grpc.time_ms=0.317 pid=892 span.kind=server system=grpc1922gitlab # [ 240.985164] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/efd95633fb617e761aecae84202359f9c0f6b219 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 991923gitlab # [ 240.985575] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 421924gitlab # [ 240.986131] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.885Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"1cb2166de57d0caa45b8511b","created_at":"2026-10-08T16:12:29.118Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.120Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-1cb2166de57d0caa45b8511b: done: 0.025215 sec","job_status":"done","queue_duration_s":1.739842,"scheduling_latency_s":1.739856,"redis_calls":10,"redis_duration_s":0.001356,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000753,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216229,"duration_s":0.025215,"completed_at":"2026-10-08T16:12:30.885Z","load_balancing_strategy":"primary","db_duration_s":0.00748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1925gitlab # [ 241.029633] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.886Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"79229e33bf2de423acfc2fb4","created_at":"2026-10-08T16:12:29.125Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.128Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-79229e33bf2de423acfc2fb4: start","job_status":"start","queue_duration_s":1.7585,"scheduling_latency_s":1.758513}1926gitlab # [ 241.030500] gitaly[892]: time="2026-10-08T16:12:31.014Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:31.014" grpc.time_ms=0.372 pid=892 span.kind=server system=grpc1927gitlab # [ 241.031913] gitaly[892]: time="2026-10-08T16:12:31.016Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9C8R9V15T72Q1WSB7TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:01.015" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.015" grpc.time_ms=0.594 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 241.044422] nixbot[2612]: {"ts": "2026-10-08T16:12:31.161Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48230 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1\" 200"}1929gitlab # [ 241.045126] gitlab-workhorse[822]: time="2026-10-08T16:12:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671930gitlab # [ 241.045567] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 391931gitlab # [ 241.046728] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.930Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"79229e33bf2de423acfc2fb4","created_at":"2026-10-08T16:12:29.125Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.128Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-79229e33bf2de423acfc2fb4: done: 0.043613 sec","job_status":"done","queue_duration_s":1.7585,"scheduling_latency_s":1.758513,"redis_calls":14,"redis_duration_s":0.003224,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000238,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000908496,"duration_s":0.043613,"completed_at":"2026-10-08T16:12:30.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1932gitlab # [ 241.090207] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:30.931Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f360eae6cac481088e94b38f","created_at":"2026-10-08T16:12:29.181Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.183Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f360eae6cac481088e94b38f: start","job_status":"start","queue_duration_s":1.748125,"scheduling_latency_s":1.748139}1933gitlab # [ 241.098132] gitaly[892]: time="2026-10-08T16:12:31.038Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:31.038" grpc.time_ms=0.3 pid=892 span.kind=server system=grpc1934gitlab # [ 241.106787] gitaly[892]: time="2026-10-08T16:12:31.045Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K9C8R9V15T72Q1WSB7TZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:41.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.037" grpc.time_ms=7.43 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935gitlab # [ 241.145790] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 441936gitlab # [ 241.146613] gitlab-workhorse[822]: time="2026-10-08T16:12:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671937gitlab # [ 241.147115] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 361938gitlab # [ 241.147575] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.145Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"86c30d2c09e9f7d6ead63759","created_at":"2026-10-08T16:12:31.143Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"f360eae6cac481088e94b38f","job_size_bytes":3,"pid":2487,"job_status":"deduplicated","message":"PipelineProcessWorker JID-86c30d2c09e9f7d6ead63759: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1939gitlab # [ 241.147800] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.146Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f360eae6cac481088e94b38f","created_at":"2026-10-08T16:12:29.181Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.183Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2487,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f360eae6cac481088e94b38f: rescheduled"}1940gitlab # [ 241.150589] gitaly[892]: time="2026-10-08T16:12:31.047Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W diskcache=fd347280-d694-44c0-8d58-a6590795c1bb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:00.076" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:30.976" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941gitlab # [ 241.159194] gitaly[892]: time="2026-10-08T16:12:31.048Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7414 command.oublock=0 command.real_time_ms=64 command.spawn_token_fork_ms=0 command.system_time_ms=29 command.user_time_ms=36 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:00.076" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:30.976" grpc.time_ms=71.191 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1942gitlab # [ 241.208567] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.150Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"f360eae6cac481088e94b38f","created_at":"2026-10-08T16:12:29.181Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-4129d9f2800f41c2","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.183Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f360eae6cac481088e94b38f: done: 0.218682 sec","job_status":"done","queue_duration_s":1.748125,"scheduling_latency_s":1.748139,"gitaly_calls":3,"gitaly_duration_s":0.078298,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.011302999999999999,"redis_read_bytes":231,"redis_write_bytes":18468,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000346,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000601,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.002646,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.005741,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000156,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000334,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084604,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.193933866,"duration_s":0.218682,"completed_at":"2026-10-08T16:12:31.150Z","load_balancing_strategy":"primary","db_duration_s":0.041775,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1943gitlab # [ 241.217072] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.151Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d6527f76ce0d9eb310dfcc20","created_at":"2026-10-08T16:12:29.254Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5ddac3b9b6bcfacd2e5547e4","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.256Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d6527f76ce0d9eb310dfcc20: start","job_status":"start","queue_duration_s":1.894707,"scheduling_latency_s":1.895082}1944gitlab # [ 241.269525] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 331945gitlab # [ 241.270250] gitlab-workhorse[822]: time="2026-10-08T16:12:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211946gitlab # [ 241.270654] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 461947gitlab # [ 241.271207] gitaly[892]: time="2026-10-08T16:12:31.116Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:13:01.115" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.115" grpc.time_ms=1.112 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 241.271668] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.187Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d6527f76ce0d9eb310dfcc20","created_at":"2026-10-08T16:12:29.254Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5ddac3b9b6bcfacd2e5547e4","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.256Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d6527f76ce0d9eb310dfcc20: done: 0.03647 sec","job_status":"done","queue_duration_s":1.894707,"scheduling_latency_s":1.895082,"gitaly_calls":1,"gitaly_duration_s":0.014201,"redis_calls":12,"redis_duration_s":0.002398,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000368,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.022397539,"duration_s":0.03647,"completed_at":"2026-10-08T16:12:31.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1949gitlab # [ 241.323816] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.189Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3908969a87d6c815da2c0506","created_at":"2026-10-08T16:12:29.381Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6e720f99b15ebe1b270ab828a22f3984e820f137da83edfe883e0a399f15a0cb","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.383Z","job_size_bytes":467,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3908969a87d6c815da2c0506: start","job_status":"start","queue_duration_s":1.806148,"scheduling_latency_s":1.806161}1950gitlab # [ 241.324656] gitaly[892]: time="2026-10-08T16:12:31.139Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:01.138" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.139" grpc.time_ms=0.507 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951gitlab # [ 241.325412] gitaly[892]: time="2026-10-08T16:12:31.157Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K9GBNRE36SS7F9KP86XG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.150" grpc.time_ms=6.803 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1952gitlab # [ 241.328179] gitaly[892]: time="2026-10-08T16:12:31.176Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE diskcache=23e5e8f6-bf3f-4bcc-9f8d-4cbc28de218b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-08T22:12:31.165" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.165" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1953gitlab # [ 241.337078] gitaly[892]: time="2026-10-08T16:12:31.176Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-08T22:12:31.165" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.165" grpc.time_ms=11.274 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954gitlab # [ 241.349137] gitaly[892]: time="2026-10-08T16:12:31.198Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9HQHJTGY440W39S3YJV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.192" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1955gitlab # [ 241.387787] gitaly[892]: time="2026-10-08T16:12:31.198Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9HQHJTGY440W39S3YJV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.192" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1956gitlab # [ 241.388647] gitaly[892]: time="2026-10-08T16:12:31.198Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9HQHJTGY440W39S3YJV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.192" grpc.time_ms=6.216 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1957gitlab # [ 241.389469] gitaly[892]: time="2026-10-08T16:12:31.203Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:01.202" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.203" grpc.time_ms=0.535 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 241.430822] gitaly[892]: time="2026-10-08T16:12:31.211Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-08T16:12:41.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.206" grpc.time_ms=4.74 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 241.431603] gitaly[892]: time="2026-10-08T16:12:31.235Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:13:01.034" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.235" grpc.time_ms=0.541 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 241.432400] gitaly[892]: time="2026-10-08T16:12:31.241Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=325 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-08T16:13:01.037" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.238" grpc.time_ms=3.382 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 241.433066] gitaly[892]: time="2026-10-08T16:12:31.263Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:41.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.256" grpc.time_ms=7.282 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 241.477265] sidekiq-cluster[2487]: {"severity":"WARN","time":"2026-10-08T16:12:31.629Z","class":"CreatePipelineWorker","correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"efd95633fb617e761aecae84202359f9c0f6b219","after":"8f5fa1331c0ec995c36a7ded702dd06b50d31b58","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"8f5fa1331c0ec995c36a7ded702dd06b50d31b58","ref":"refs/heads/master"},"retry":0}1963gitlab # [ 241.478101] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.632Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"3908969a87d6c815da2c0506","created_at":"2026-10-08T16:12:29.381Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6e720f99b15ebe1b270ab828a22f3984e820f137da83edfe883e0a399f15a0cb","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.383Z","job_size_bytes":467,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-3908969a87d6c815da2c0506: done: 0.443594 sec","job_status":"done","queue_duration_s":1.806148,"scheduling_latency_s":1.806161,"gitaly_calls":7,"gitaly_duration_s":0.042423,"redis_calls":33,"redis_duration_s":0.003966,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000488,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002136,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.380632,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.443594,"completed_at":"2026-10-08T16:12:31.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014738,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1964gitlab # [ 241.523123] nixbot[2612]: {"ts": "2026-10-08T16:12:31.650Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "0c397b60-8134-45cf-a6ca-ac5fc3ce1a4c", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "8f5fa1331c0ec995c36a7ded702dd06b50d31b58", "pr": null}1965gitlab # [ 241.523676] nixbot[2612]: {"ts": "2026-10-08T16:12:31.652Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48236 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1966gitlab # [ 241.524190] gitaly[892]: time="2026-10-08T16:12:31.270Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K9KV2SKARK7H8Y7H6KHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.264" grpc.time_ms=6.344 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1967gitlab # [ 241.524625] gitaly[892]: time="2026-10-08T16:12:31.308Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9N8SDX5NMPB7N5FJQ4V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.301" pid=892 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1968gitlab # [ 241.525424] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.634Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"d5923f23-0b8a-405f-ab92-ef33236fd113\"}"],"class":"WebHookWorker","jid":"147b0f87645249bff9f7dc16","created_at":"2026-10-08T16:12:29.391Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b1e3e6f319d37e28d2d0dca8a4db2abf87ed78d28ea073706a5012edaa89aa77","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.392Z","job_size_bytes":1749,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-147b0f87645249bff9f7dc16: start","job_status":"start","queue_duration_s":2.241283,"scheduling_latency_s":2.241712}1969gitlab # [ 241.533538] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.660Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"d5923f23-0b8a-405f-ab92-ef33236fd113\"}"],"class":"WebHookWorker","jid":"147b0f87645249bff9f7dc16","created_at":"2026-10-08T16:12:29.391Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-b07fe92d12a34cee","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b1e3e6f319d37e28d2d0dca8a4db2abf87ed78d28ea073706a5012edaa89aa77","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.392Z","job_size_bytes":1749,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-147b0f87645249bff9f7dc16: done: 0.026187 sec","job_status":"done","queue_duration_s":2.241283,"scheduling_latency_s":2.241712,"redis_calls":14,"redis_duration_s":0.0018269999999999998,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.000322,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0046123179999995045,"cpu_s":0.016044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.026187,"completed_at":"2026-10-08T16:12:31.660Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1970gitlab # [ 241.612955] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 401971gitlab # [ 241.613546] gitlab-workhorse[822]: time="2026-10-08T16:12:31Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671972gitlab # [ 241.614061] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 421973gitlab # [ 241.614582] gitaly[892]: time="2026-10-08T16:12:31.308Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9N8SDX5NMPB7N5FJQ4V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.301" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1974gitlab # [ 241.615233] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e89708ce1a8f7e8ff887f396","created_at":"2026-10-08T16:12:29.485Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-591ddb692a1a42f8","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.488Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e89708ce1a8f7e8ff887f396: start","job_status":"start","queue_duration_s":2.172484,"scheduling_latency_s":2.172503}1975gitlab # [ 241.615843] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.697Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"e89708ce1a8f7e8ff887f396","created_at":"2026-10-08T16:12:29.485Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-591ddb692a1a42f8","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:29.488Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-e89708ce1a8f7e8ff887f396: done: 0.0367 sec","job_status":"done","queue_duration_s":2.172484,"scheduling_latency_s":2.172503,"redis_calls":19,"redis_duration_s":0.004183,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002036,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000367,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.007167671,"duration_s":0.0367,"completed_at":"2026-10-08T16:12:31.697Z","load_balancing_strategy":"primary","db_duration_s":0.006919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1976gitlab # [ 241.673850] gitaly[892]: time="2026-10-08T16:12:31.310Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9N8SDX5NMPB7N5FJQ4V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.301" grpc.time_ms=7.138 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1977gitlab # [ 241.674674] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.699Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","f02ab36c00595de207cf4b7f"],"class":"WebHooks::LogExecutionWorker","jid":"e3037cc325db3927d4cb66e9","created_at":"2026-10-08T16:12:30.383Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-2e3d75a0d4ff40d5","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5769267e102e2281682ccb2dcbcd44dcfca156783bdc4d3fd8b5be83d2b230a","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:30.390Z","job_size_bytes":2593,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e3037cc325db3927d4cb66e9: start","job_status":"start","queue_duration_s":1.308902,"scheduling_latency_s":1.308915}1978gitlab # [ 241.678797] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.732Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","f02ab36c00595de207cf4b7f"],"class":"WebHooks::LogExecutionWorker","jid":"e3037cc325db3927d4cb66e9","created_at":"2026-10-08T16:12:30.383Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-2e3d75a0d4ff40d5","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5769267e102e2281682ccb2dcbcd44dcfca156783bdc4d3fd8b5be83d2b230a","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:30.390Z","job_size_bytes":2593,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-e3037cc325db3927d4cb66e9: done: 0.033936 sec","job_status":"done","queue_duration_s":1.308902,"scheduling_latency_s":1.308915,"redis_calls":10,"redis_duration_s":0.001577,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222375,"duration_s":0.033936,"completed_at":"2026-10-08T16:12:31.732Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1979gitlab # [ 241.724198] gitaly[892]: time="2026-10-08T16:12:31.365Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K9Q48RHQ0Z31R1Y3T19M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.359" grpc.time_ms=5.973 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1980gitlab # [ 241.766664] gitaly[892]: time="2026-10-08T16:12:31.413Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9R7JMDQAM6NHRZCVHJS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.397" pid=892 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1981gitlab # [ 241.767610] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.734Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9979610df8675c307ef70bbe","created_at":"2026-10-08T16:12:30.970Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:30.972Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9979610df8675c307ef70bbe: start","job_status":"start","queue_duration_s":0.761634,"scheduling_latency_s":0.761648}1982gitlab # [ 241.768234] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.762Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9979610df8675c307ef70bbe","created_at":"2026-10-08T16:12:30.970Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:30.972Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9979610df8675c307ef70bbe: done: 0.028315 sec","job_status":"done","queue_duration_s":0.761634,"scheduling_latency_s":0.761648,"redis_calls":7,"redis_duration_s":0.0012230000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028315,"completed_at":"2026-10-08T16:12:31.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005384,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1983gitlab # [ 241.794154] gitaly[892]: time="2026-10-08T16:12:31.413Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=9 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9R7JMDQAM6NHRZCVHJS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.397" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1984gitlab # [ 241.838617] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.763Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"8d39e860ceede6dc217185c0","created_at":"2026-10-08T16:12:31.053Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.057Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-8d39e860ceede6dc217185c0: start","job_status":"start","queue_duration_s":0.705695,"scheduling_latency_s":0.705713}1985gitlab # [ 241.839917] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.780Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"8d39e860ceede6dc217185c0","created_at":"2026-10-08T16:12:31.053Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.057Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-8d39e860ceede6dc217185c0: done: 0.017212 sec","job_status":"done","queue_duration_s":0.705695,"scheduling_latency_s":0.705713,"redis_calls":7,"redis_duration_s":0.001156,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017212,"completed_at":"2026-10-08T16:12:31.780Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986gitlab # [ 241.885678] nixbot[2612]: {"ts": "2026-10-08T16:12:31.995Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-8f5fa1331c0e-6"}1987gitlab # [ 241.887222] gitaly[892]: time="2026-10-08T16:12:31.413Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=9 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4K9R7JMDQAM6NHRZCVHJS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.397" grpc.time_ms=16.297 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc1988gitlab # [ 241.887849] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2071989gitlab # [ 241.888447] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.781Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1f90b183fa5e9f60296e76a2","created_at":"2026-10-08T16:12:31.062Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.064Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1f90b183fa5e9f60296e76a2: start","job_status":"start","queue_duration_s":0.716589,"scheduling_latency_s":0.716602}1990gitlab # [ 241.893590] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.804Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"1f90b183fa5e9f60296e76a2","created_at":"2026-10-08T16:12:31.062Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.064Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-1f90b183fa5e9f60296e76a2: done: 0.022908 sec","job_status":"done","queue_duration_s":0.716589,"scheduling_latency_s":0.716602,"redis_calls":7,"redis_duration_s":0.001607,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022908,"completed_at":"2026-10-08T16:12:31.804Z","load_balancing_strategy":"primary","db_duration_s":0.00302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58'1992gitlab # [ 241.950362] gitaly[892]: time="2026-10-08T16:12:31.611Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=963 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-08T16:13:01.402" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.602" grpc.time_ms=8.328 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 241.950954] nixbot[2612]: {"ts": "2026-10-08T16:12:32.085Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-8f5fa1331c0e-6", "argv0": "bwrap"}1994gitlab # [ 241.951576] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.808Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"59931b42afa382a5c0014d72","created_at":"2026-10-08T16:12:31.089Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.091Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-59931b42afa382a5c0014d72: start","job_status":"start","queue_duration_s":0.7171,"scheduling_latency_s":0.717119}1995gitlab # [ 241.996845] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.830Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"59931b42afa382a5c0014d72","created_at":"2026-10-08T16:12:31.089Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.091Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-59931b42afa382a5c0014d72: done: 0.021487 sec","job_status":"done","queue_duration_s":0.7171,"scheduling_latency_s":0.717119,"redis_calls":10,"redis_duration_s":0.002005,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000361,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000354,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021487,"completed_at":"2026-10-08T16:12:31.830Z","load_balancing_strategy":"primary","db_duration_s":0.00345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1996gitlab # [ 241.998292] gitaly[892]: time="2026-10-08T16:12:31.619Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4K5MGWTRQ4ZPJ9E8JRAGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-08T16:13:01.412" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.612" grpc.time_ms=6.998 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1997gitlab # [ 242.041261] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.831Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ee6f7996cc9d8c2993f8527e","created_at":"2026-10-08T16:12:31.092Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.093Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ee6f7996cc9d8c2993f8527e: start","job_status":"start","queue_duration_s":0.737688,"scheduling_latency_s":0.737703}1998gitlab # [ 242.041903] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ee6f7996cc9d8c2993f8527e","created_at":"2026-10-08T16:12:31.092Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.093Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ee6f7996cc9d8c2993f8527e: done: 0.015852 sec","job_status":"done","queue_duration_s":0.737688,"scheduling_latency_s":0.737703,"redis_calls":7,"redis_duration_s":0.000909,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000219,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015852,"completed_at":"2026-10-08T16:12:31.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1999gitlab # [ 242.086579] gitaly[892]: time="2026-10-08T16:12:31.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KA1KGTHM5NWFPTBQTWKT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.701" grpc.time_ms=6.046 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2000gitlab # [ 242.087256] gitaly[892]: time="2026-10-08T16:12:31.751Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA2YF0CDKB1G7R4KFH2W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.743" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2001gitlab # [ 242.088024] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8fff129366988b5daad6c027","created_at":"2026-10-08T16:12:31.093Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.097Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8fff129366988b5daad6c027: start","job_status":"start","queue_duration_s":0.750855,"scheduling_latency_s":0.750869}2002gitlab # [ 242.097446] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.867Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"8fff129366988b5daad6c027","created_at":"2026-10-08T16:12:31.093Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.097Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-8fff129366988b5daad6c027: done: 0.019483 sec","job_status":"done","queue_duration_s":0.750855,"scheduling_latency_s":0.750869,"redis_calls":8,"redis_duration_s":0.001521,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019483,"completed_at":"2026-10-08T16:12:31.867Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2003gitlab # [ 242.169212] gitaly[892]: time="2026-10-08T16:12:31.751Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA2YF0CDKB1G7R4KFH2W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.743" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2004gitlab # [ 242.169960] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.868Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"6bec5502bca49d599f7bc419","created_at":"2026-10-08T16:12:31.099Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.101Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-6bec5502bca49d599f7bc419: start","job_status":"start","queue_duration_s":0.76712,"scheduling_latency_s":0.767134}2005gitlab # [ 242.170556] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.885Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"6bec5502bca49d599f7bc419","created_at":"2026-10-08T16:12:31.099Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.101Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-6bec5502bca49d599f7bc419: done: 0.016469 sec","job_status":"done","queue_duration_s":0.76712,"scheduling_latency_s":0.767134,"redis_calls":7,"redis_duration_s":0.001135,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000784,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000351,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016469,"completed_at":"2026-10-08T16:12:31.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 242.218744] gitaly[892]: time="2026-10-08T16:12:31.751Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA2YF0CDKB1G7R4KFH2W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:31.743" grpc.time_ms=8.433 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2007gitlab # [ 242.219567] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.886Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5db3947fa64e2f5f0e4d3b35","created_at":"2026-10-08T16:12:31.101Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.103Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5db3947fa64e2f5f0e4d3b35: start","job_status":"start","queue_duration_s":0.782422,"scheduling_latency_s":0.782439}2008gitlab # [ 242.263759] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.905Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5db3947fa64e2f5f0e4d3b35","created_at":"2026-10-08T16:12:31.101Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.103Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5db3947fa64e2f5f0e4d3b35: done: 0.019501 sec","job_status":"done","queue_duration_s":0.782422,"scheduling_latency_s":0.782439,"redis_calls":7,"redis_duration_s":0.001056,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000756,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019501,"completed_at":"2026-10-08T16:12:31.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 242.267794] gitaly[892]: time="2026-10-08T16:12:31.820Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:01.219" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.819" grpc.time_ms=0.448 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 242.279937] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.906Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"dc9c741120e37a42016e4954","created_at":"2026-10-08T16:12:31.104Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.105Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-dc9c741120e37a42016e4954: start","job_status":"start","queue_duration_s":0.801295,"scheduling_latency_s":0.801311}2011gitlab # [ 242.320843] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.918Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"dc9c741120e37a42016e4954","created_at":"2026-10-08T16:12:31.104Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.105Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-dc9c741120e37a42016e4954: done: 0.01149 sec","job_status":"done","queue_duration_s":0.801295,"scheduling_latency_s":0.801311,"redis_calls":7,"redis_duration_s":0.002288,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000298,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01149,"completed_at":"2026-10-08T16:12:31.918Z","load_balancing_strategy":"primary","db_duration_s":0.000335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2012gitlab # [ 242.331616] gitaly[892]: time="2026-10-08T16:12:31.832Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=651 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-08T16:13:01.225" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.825" grpc.time_ms=6.314 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 242.376291] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"44220f167e7c391c7f7a997f","created_at":"2026-10-08T16:12:31.105Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.106Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-44220f167e7c391c7f7a997f: start","job_status":"start","queue_duration_s":0.812468,"scheduling_latency_s":0.812484}2014gitlab # [ 242.377031] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"44220f167e7c391c7f7a997f","created_at":"2026-10-08T16:12:31.105Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.106Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-44220f167e7c391c7f7a997f: done: 0.016399 sec","job_status":"done","queue_duration_s":0.812468,"scheduling_latency_s":0.812484,"redis_calls":7,"redis_duration_s":0.0009320000000000001,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000702,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00023,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016399,"completed_at":"2026-10-08T16:12:31.935Z","load_balancing_strategy":"primary","db_duration_s":0.002682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2015gitlab # [ 242.393617] gitaly[892]: time="2026-10-08T16:12:31.843Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:41.265" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.836" grpc.time_ms=7.045 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016gitlab # [ 242.438074] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:31.936Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7e0e5a522bee8bad4789f7c2","created_at":"2026-10-08T16:12:31.146Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.147Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7e0e5a522bee8bad4789f7c2: start","job_status":"start","queue_duration_s":0.789206,"scheduling_latency_s":0.789218}2017gitlab # [ 242.438691] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.125Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"7e0e5a522bee8bad4789f7c2","created_at":"2026-10-08T16:12:31.146Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-3c9141a322824d5e","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.147Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7e0e5a522bee8bad4789f7c2: done: 0.188775 sec","job_status":"done","queue_duration_s":0.789206,"scheduling_latency_s":0.789218,"gitaly_calls":3,"gitaly_duration_s":0.083809,"redis_calls":63,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.0076,"redis_read_bytes":146,"redis_write_bytes":16719,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000358,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000707,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.001678,"redis_queues_read_bytes":26,"redis_queues_write_bytes":11225,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.002787,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00022,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000353,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078051,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.167114815,"duration_s":0.188775,"completed_at":"2026-10-08T16:12:32.125Z","load_balancing_strategy":"primary","db_duration_s":0.022001,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2018gitlab # [ 242.491790] gitaly[892]: time="2026-10-08T16:12:31.857Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-08T16:12:41.286" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:31.856" grpc.time_ms=0.219 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 242.492578] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.126Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","147b0f87645249bff9f7dc16"],"class":"WebHooks::LogExecutionWorker","jid":"fe927337b04d97e687982de1","created_at":"2026-10-08T16:12:31.653Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-e636876d9b194c2d","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b70fb51fe488b9cf9f64249ea74cfcb404eb80f96c262df551d417d87fb96b99","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.655Z","job_size_bytes":2592,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-fe927337b04d97e687982de1: start","job_status":"start","queue_duration_s":0.47103,"scheduling_latency_s":0.471044}2020gitlab # [ 242.493208] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.148Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","147b0f87645249bff9f7dc16"],"class":"WebHooks::LogExecutionWorker","jid":"fe927337b04d97e687982de1","created_at":"2026-10-08T16:12:31.653Z","trace_propagation_headers":{"sentry-trace":"b81d4beefaa5448f83ec336464281f04-e636876d9b194c2d","baggage":"sentry-trace_id=b81d4beefaa5448f83ec336464281f04,sentry-release=Unknown"},"correlation_id":"01M4E4K5MGWTRQ4ZPJ9E8JRAGE","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b70fb51fe488b9cf9f64249ea74cfcb404eb80f96c262df551d417d87fb96b99","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.655Z","job_size_bytes":2592,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-fe927337b04d97e687982de1: done: 0.02184 sec","job_status":"done","queue_duration_s":0.47103,"scheduling_latency_s":0.471044,"redis_calls":7,"redis_duration_s":0.0011740000000000001,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02184,"completed_at":"2026-10-08T16:12:32.148Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006567,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2021gitlab # [ 242.544697] gitaly[892]: time="2026-10-08T16:12:31.867Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-08T16:12:41.290" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.860" grpc.time_ms=5.499 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 242.545527] gitaly[892]: time="2026-10-08T16:12:31.897Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:31.896" grpc.time_ms=0.61 pid=892 span.kind=server system=grpc2023gitlab # [ 242.546516] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.149Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e614d9bdb1e308a68b8642a7","created_at":"2026-10-08T16:12:31.686Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-e500304d76ac4814","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.691Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e614d9bdb1e308a68b8642a7: start","job_status":"start","queue_duration_s":0.457936,"scheduling_latency_s":0.457954}2024gitlab # [ 242.596595] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.208Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"e614d9bdb1e308a68b8642a7","created_at":"2026-10-08T16:12:31.686Z","trace_propagation_headers":{"sentry-trace":"d29b5ea0ef5d43e6ab632deda06ba373-e500304d76ac4814","baggage":"sentry-trace_id=d29b5ea0ef5d43e6ab632deda06ba373,sentry-release=Unknown"},"correlation_id":"01M4E4HVVK54WMJQ0NVE6M3TY2","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.691Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-e614d9bdb1e308a68b8642a7: done: 0.059005 sec","job_status":"done","queue_duration_s":0.457936,"scheduling_latency_s":0.457954,"redis_calls":11,"redis_duration_s":0.002169,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001556,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000565715,"duration_s":0.059005,"completed_at":"2026-10-08T16:12:32.208Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 242.602063] gitaly[892]: time="2026-10-08T16:12:31.915Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:31.915" grpc.time_ms=0.282 pid=892 span.kind=server system=grpc2026gitlab # [ 242.610566] gitaly[892]: time="2026-10-08T16:12:31.926Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP diskcache=07ebfc36-1e95-4444-a0af-8e432091ae32 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-08T16:12:41.009" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:31.869" pid=892 ref=refs/keep-around/8f5fa1331c0ec995c36a7ded702dd06b50d31b58 remote_ip="2001:db8:1::1" revision=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 span.kind=server system=grpc username=root2027gitlab # [ 242.654044] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.209Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6ec4d3e2d7f60080f0b0fa3f","created_at":"2026-10-08T16:12:31.931Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-050080963c9e4184","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.933Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6ec4d3e2d7f60080f0b0fa3f: start","job_status":"start","queue_duration_s":0.275885,"scheduling_latency_s":0.275898}2028gitlab # [ 242.654733] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.228Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"6ec4d3e2d7f60080f0b0fa3f","created_at":"2026-10-08T16:12:31.931Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-050080963c9e4184","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.933Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-6ec4d3e2d7f60080f0b0fa3f: done: 0.01879 sec","job_status":"done","queue_duration_s":0.275885,"scheduling_latency_s":0.275898,"redis_calls":7,"redis_duration_s":0.000919,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000233,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01879,"completed_at":"2026-10-08T16:12:32.228Z","load_balancing_strategy":"primary","db_duration_s":0.003354,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2029gitlab # [ 242.695857] gitaly[892]: time="2026-10-08T16:12:31.926Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=42 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5245 command.oublock=8 command.real_time_ms=47 command.spawn_token_fork_ms=1 command.system_time_ms=26 command.user_time_ms=16 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-08T16:12:41.009" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-08T16:12:31.869" grpc.time_ms=56.727 pid=892 ref=refs/keep-around/8f5fa1331c0ec995c36a7ded702dd06b50d31b58 remote_ip="2001:db8:1::1" revision=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 span.kind=server system=grpc username=root2030gitlab # [ 242.696296] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.229Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a34e1e99104d00177355dce4","created_at":"2026-10-08T16:12:31.934Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-050080963c9e4184","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.935Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a34e1e99104d00177355dce4: start","job_status":"start","queue_duration_s":0.294203,"scheduling_latency_s":0.294217}2031gitlab # [ 242.702844] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.259Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"a34e1e99104d00177355dce4","created_at":"2026-10-08T16:12:31.934Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-050080963c9e4184","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.935Z","job_size_bytes":65,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-a34e1e99104d00177355dce4: done: 0.029867 sec","job_status":"done","queue_duration_s":0.294203,"scheduling_latency_s":0.294217,"redis_calls":10,"redis_duration_s":0.001644,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000805,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029867,"completed_at":"2026-10-08T16:12:32.259Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2032gitlab # [ 242.759160] gitaly[892]: time="2026-10-08T16:12:31.929Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:01.328" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:31.929" grpc.time_ms=0.642 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 242.759810] gitaly[892]: time="2026-10-08T16:12:32.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:32.007" grpc.time_ms=0.288 pid=892 span.kind=server system=grpc2034gitlab # [ 242.763115] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.259Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"eed1c784f5e4a120659a4485","created_at":"2026-10-08T16:12:31.973Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-050080963c9e4184","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.975Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eed1c784f5e4a120659a4485: start","job_status":"start","queue_duration_s":0.284693,"scheduling_latency_s":0.284707}2035gitlab # [ 242.815683] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"eed1c784f5e4a120659a4485","created_at":"2026-10-08T16:12:31.973Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-050080963c9e4184","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.975Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eed1c784f5e4a120659a4485: done: 0.075024 sec","job_status":"done","queue_duration_s":0.284693,"scheduling_latency_s":0.284707,"gitaly_calls":2,"gitaly_duration_s":0.004925,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.003956,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000591,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000729,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000179,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000145,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000262,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053361,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.057949544,"duration_s":0.075024,"completed_at":"2026-10-08T16:12:32.334Z","load_balancing_strategy":"primary","db_duration_s":0.017042,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2036gitlab # [ 242.824113] gitaly[892]: time="2026-10-08T16:12:32.033Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:32.030" grpc.time_ms=2.727 pid=892 span.kind=server system=grpc2037gitlab # [ 242.832957] gitaly[892]: time="2026-10-08T16:12:32.050Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:32.050" grpc.time_ms=0.261 pid=892 span.kind=server system=grpc2038gitlab # [ 242.873076] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.336Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"76cc7ef50aca7f897ab63a0f","created_at":"2026-10-08T16:12:31.979Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.981Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-76cc7ef50aca7f897ab63a0f: start","job_status":"start","queue_duration_s":0.354615,"scheduling_latency_s":0.35463}2039gitlab # [ 242.873718] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.362Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"76cc7ef50aca7f897ab63a0f","created_at":"2026-10-08T16:12:31.979Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:31.981Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-76cc7ef50aca7f897ab63a0f: done: 0.026466 sec","job_status":"done","queue_duration_s":0.354615,"scheduling_latency_s":0.35463,"redis_calls":7,"redis_duration_s":0.001086,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026466,"completed_at":"2026-10-08T16:12:32.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004546,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2040gitlab # [ 242.924453] gitaly[892]: time="2026-10-08T16:12:32.054Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.985" operations="[repack_refs]" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2041gitlab # [ 242.925095] gitaly[892]: time="2026-10-08T16:12:32.055Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.985" pid=892 remote_ip="2001:db8:1::1" repository_info="{false {6 704 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-08 16:11:37.279283659 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2042gitlab # [ 242.925705] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.363Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3c92cb873148db29a7b53c9c","created_at":"2026-10-08T16:12:32.066Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.068Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3c92cb873148db29a7b53c9c: start","job_status":"start","queue_duration_s":0.295389,"scheduling_latency_s":0.295405}2043gitlab # [ 242.929553] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.378Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3c92cb873148db29a7b53c9c","created_at":"2026-10-08T16:12:32.066Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.068Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3c92cb873148db29a7b53c9c: done: 0.015558 sec","job_status":"done","queue_duration_s":0.295389,"scheduling_latency_s":0.295405,"redis_calls":7,"redis_duration_s":0.001106,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015558,"completed_at":"2026-10-08T16:12:32.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2044gitlab # [ 242.983903] gitaly[892]: time="2026-10-08T16:12:32.061Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W diskcache=64228583-9ec7-4bdd-9795-417ee5d0d269 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.985" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045gitlab # [ 242.984603] gitaly[892]: time="2026-10-08T16:12:32.062Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=71 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7934 command.oublock=0 command.real_time_ms=70 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.985" grpc.time_ms=76.876 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046gitlab # [ 243.023734] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.379Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d324ea8d6c8248a625e11eb3","created_at":"2026-10-08T16:12:32.072Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.073Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d324ea8d6c8248a625e11eb3: start","job_status":"start","queue_duration_s":0.305967,"scheduling_latency_s":0.305981}2047gitlab # [ 243.024638] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.399Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d324ea8d6c8248a625e11eb3","created_at":"2026-10-08T16:12:32.072Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.073Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d324ea8d6c8248a625e11eb3: done: 0.019622 sec","job_status":"done","queue_duration_s":0.305967,"scheduling_latency_s":0.305981,"redis_calls":7,"redis_duration_s":0.0011719999999999999,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019622,"completed_at":"2026-10-08T16:12:32.399Z","load_balancing_strategy":"primary","db_duration_s":0.003169,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2048gitlab # [ 243.064558] gitaly[892]: time="2026-10-08T16:12:32.070Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.985" pid=892 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2049gitlab # [ 243.065490] gitaly[892]: time="2026-10-08T16:12:32.071Z" level=info msg="optimized repository" clean_stale_data_time=14.785678ms clean_work_trees_time="70.68µs" commit_graph_time="3.632µs" correlation_id=01M4E4J013ECMJY1BY9EA3FC3W gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=892 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="3.911µs" storage_name=default system=housekeeping total_time=14.962795ms2050gitlab # [ 243.066252] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.400Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"58e06ac7f15615f49a9e26c3","created_at":"2026-10-08T16:12:32.078Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.079Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-58e06ac7f15615f49a9e26c3: start","job_status":"start","queue_duration_s":0.320817,"scheduling_latency_s":0.320834}2051gitlab # [ 243.106281] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.419Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"58e06ac7f15615f49a9e26c3","created_at":"2026-10-08T16:12:32.078Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.079Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-58e06ac7f15615f49a9e26c3: done: 0.018813 sec","job_status":"done","queue_duration_s":0.320817,"scheduling_latency_s":0.320834,"redis_calls":10,"redis_duration_s":0.001316,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000427,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012681,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018813,"completed_at":"2026-10-08T16:12:32.419Z","load_balancing_strategy":"primary","db_duration_s":0.003357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2052gitlab # [ 243.145855] gitaly[892]: time="2026-10-08T16:12:32.071Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:01.084" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:31.985" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2053gitlab # [ 243.146681] gitaly[892]: time="2026-10-08T16:12:32.097Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:13:02.095" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:32.095" grpc.time_ms=0.988 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 243.147620] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.420Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"617c5ccc1b14c3c8ab410c1a","created_at":"2026-10-08T16:12:32.079Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.081Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-617c5ccc1b14c3c8ab410c1a: start","job_status":"start","queue_duration_s":0.33905,"scheduling_latency_s":0.339064}2055gitlab # [ 243.148154] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.434Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"617c5ccc1b14c3c8ab410c1a","created_at":"2026-10-08T16:12:32.079Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.081Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-617c5ccc1b14c3c8ab410c1a: done: 0.014722 sec","job_status":"done","queue_duration_s":0.33905,"scheduling_latency_s":0.339064,"redis_calls":7,"redis_duration_s":0.000895,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00024,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014722,"completed_at":"2026-10-08T16:12:32.434Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2056gitlab # [ 243.200754] gitaly[892]: time="2026-10-08T16:12:32.117Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4J013ECMJY1BY9EA3FC3W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:02.116" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:32.117" grpc.time_ms=0.484 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab # [ 243.201642] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.435Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c283b8abb341b87cc0e2c562","created_at":"2026-10-08T16:12:32.081Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.082Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c283b8abb341b87cc0e2c562: start","job_status":"start","queue_duration_s":0.352963,"scheduling_latency_s":0.352976}2058gitlab # [ 243.210126] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.449Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"c283b8abb341b87cc0e2c562","created_at":"2026-10-08T16:12:32.081Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.082Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-c283b8abb341b87cc0e2c562: done: 0.013831 sec","job_status":"done","queue_duration_s":0.352963,"scheduling_latency_s":0.352976,"redis_calls":8,"redis_duration_s":0.001196,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000235,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013831,"completed_at":"2026-10-08T16:12:32.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2059gitlab # [ 243.261118] gitaly[892]: time="2026-10-08T16:12:32.303Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:13:02.102" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:32.303" grpc.time_ms=0.772 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 243.261834] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.450Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"193d2601bfc6a970493aa4f4","created_at":"2026-10-08T16:12:32.083Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.084Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-193d2601bfc6a970493aa4f4: start","job_status":"start","queue_duration_s":0.365866,"scheduling_latency_s":0.365878}2061gitlab # [ 243.306130] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.463Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"193d2601bfc6a970493aa4f4","created_at":"2026-10-08T16:12:32.083Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.084Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-193d2601bfc6a970493aa4f4: done: 0.012742 sec","job_status":"done","queue_duration_s":0.365866,"scheduling_latency_s":0.365878,"redis_calls":7,"redis_duration_s":0.0008730000000000001,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000247,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012742,"completed_at":"2026-10-08T16:12:32.463Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2062gitlab # [ 243.314874] gitaly[892]: time="2026-10-08T16:12:32.328Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KA52J50J4H415ABB1ZEP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:02.127" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:32.327" grpc.time_ms=0.489 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 243.357777] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.463Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"71512606963d53f1494d7713","created_at":"2026-10-08T16:12:32.084Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.085Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-71512606963d53f1494d7713: start","job_status":"start","queue_duration_s":0.378206,"scheduling_latency_s":0.37822}2064gitlab # [ 243.358660] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.479Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"71512606963d53f1494d7713","created_at":"2026-10-08T16:12:32.084Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.085Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-71512606963d53f1494d7713: done: 0.015196 sec","job_status":"done","queue_duration_s":0.378206,"scheduling_latency_s":0.37822,"redis_calls":7,"redis_duration_s":0.00094,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015196,"completed_at":"2026-10-08T16:12:32.479Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2065gitlab # [ 243.400736] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.480Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f27cc7d757bad53dba262ee5","created_at":"2026-10-08T16:12:32.086Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.086Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f27cc7d757bad53dba262ee5: start","job_status":"start","queue_duration_s":0.393191,"scheduling_latency_s":0.393203}2066gitlab # [ 243.401601] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f27cc7d757bad53dba262ee5","created_at":"2026-10-08T16:12:32.086Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.086Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f27cc7d757bad53dba262ee5: done: 0.008239 sec","job_status":"done","queue_duration_s":0.393191,"scheduling_latency_s":0.393203,"redis_calls":7,"redis_duration_s":0.0009480000000000001,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005391,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008239,"completed_at":"2026-10-08T16:12:32.488Z","load_balancing_strategy":"primary","db_duration_s":0.000243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2067gitlab # [ 243.444768] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.489Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7750a7bbb44e00fb7c6a8175","created_at":"2026-10-08T16:12:32.087Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.087Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7750a7bbb44e00fb7c6a8175: start","job_status":"start","queue_duration_s":0.401129,"scheduling_latency_s":0.401141}2068gitlab # [ 243.445635] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.502Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"7750a7bbb44e00fb7c6a8175","created_at":"2026-10-08T16:12:32.087Z","trace_propagation_headers":{"sentry-trace":"027e4d718eff4d3d942ac629a4e9b860-819b847fc1d04c1d","baggage":"sentry-trace_id=027e4d718eff4d3d942ac629a4e9b860,sentry-release=Unknown"},"correlation_id":"01M4E4J013ECMJY1BY9EA3FC3W","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.087Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-7750a7bbb44e00fb7c6a8175: done: 0.013769 sec","job_status":"done","queue_duration_s":0.401129,"scheduling_latency_s":0.401141,"redis_calls":7,"redis_duration_s":0.000958,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013769,"completed_at":"2026-10-08T16:12:32.502Z","load_balancing_strategy":"primary","db_duration_s":0.001887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2069gitlab # [ 243.497375] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.503Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"49a5ebb903ac40fbd4b9b834","created_at":"2026-10-08T16:12:32.293Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-223162fbf6df4db6","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.294Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-49a5ebb903ac40fbd4b9b834: start","job_status":"start","queue_duration_s":0.208928,"scheduling_latency_s":0.208941}2070gitlab # [ 243.498041] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:32.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"49a5ebb903ac40fbd4b9b834","created_at":"2026-10-08T16:12:32.293Z","trace_propagation_headers":{"sentry-trace":"964ac176346b4e7984fb392196e399cd-223162fbf6df4db6","baggage":"sentry-trace_id=964ac176346b4e7984fb392196e399cd,sentry-release=Unknown"},"correlation_id":"01M4E4KA52J50J4H415ABB1ZEP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:32.294Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-49a5ebb903ac40fbd4b9b834: done: 0.018752 sec","job_status":"done","queue_duration_s":0.208928,"scheduling_latency_s":0.208941,"redis_calls":7,"redis_duration_s":0.000904,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018752,"completed_at":"2026-10-08T16:12:32.522Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002573,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 243.590495] nixbot[2612]: {"ts": "2026-10-08T16:12:33.780Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:48246 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1\" 200"}2072gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=8f5fa1331c0ec995c36a7ded702dd06b50d31b58', in 1.65 seconds)2073gitlab # [ 243.629349] nix-daemon[2772]: accepted connection from pid 3620, user nixbot2074(finished: subtest: push delivers the webhook, in 46.36 seconds)2075subtest: eval and build post commit statuses2076gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses2077gitlab # [ 243.692305] gitaly[892]: time="2026-10-08T16:12:33.882Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KC5DSYAW7SQNMXQEY5WE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:03.180" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:33.881" grpc.time_ms=0.785 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses, in 0.10 seconds)2079gitlab # [ 243.730926] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 822080gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses2081gitlab # [ 244.828536] gitaly[892]: time="2026-10-08T16:12:35.018Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KD8F4VJ4P50A73EV5ARW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:05.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:35.016" grpc.time_ms=0.898 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 244.859476] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 892083gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses, in 0.13 seconds)2084gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses2085gitlab # [ 245.959987] gitaly[892]: time="2026-10-08T16:12:36.149Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KEBW99VD20DAQ8WNB7MT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:06.147" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:36.148" grpc.time_ms=0.961 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 246.001656] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 972087gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses, in 0.14 seconds)2088gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses2089gitlab # [ 247.122446] gitaly[892]: time="2026-10-08T16:12:37.312Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KFFH50QA76JGKR81Z1V1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:07.310" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:37.311" grpc.time_ms=1.013 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2090gitlab # [ 247.175203] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1302091gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses, in 0.17 seconds)2092gitlab # [ 248.048501] nix-daemon[2772]: accepted connection from pid 3660, user nixbot2093gitlab # [ 248.061910] nix-daemon[2772]: accepted connection from pid 3620, user nixbot2094gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses2095gitlab # [ 248.175222] gitaly[892]: time="2026-10-08T16:12:38.364Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:08.362" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:38.363" grpc.time_ms=0.96 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 248.224743] gitaly[892]: time="2026-10-08T16:12:38.415Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:48.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:38.402" grpc.time_ms=12.216 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2097gitlab # [ 248.271837] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.461Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2f47e06e5ff54d657c41dbb9","created_at":"2026-10-08T16:12:38.456Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-08c57403a24c4f21","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.459Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2f47e06e5ff54d657c41dbb9: start","job_status":"start","queue_duration_s":0.00177,"scheduling_latency_s":0.001809}2098gitlab # [ 248.301850] gitaly[892]: time="2026-10-08T16:12:38.492Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGMS0696TCNHJJYQMZK0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:08.480" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:38.491" grpc.time_ms=0.552 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 248.314637] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2162100gitlab # [ 248.334655] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 992101gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses, in 0.16 seconds)2102gitlab # [ 248.355209] gitaly[892]: time="2026-10-08T16:12:38.545Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGQENCP8B3C6C26Y83CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:08.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:38.544" grpc.time_ms=0.835 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 248.372226] gitaly[892]: time="2026-10-08T16:12:38.562Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:38.562" grpc.time_ms=0.483 pid=892 span.kind=server system=grpc2104gitlab # [ 248.388669] gitaly[892]: time="2026-10-08T16:12:38.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGQENCP8B3C6C26Y83CA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:48.172" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:38.572" grpc.time_ms=6.058 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2105gitlab # [ 248.398956] gitaly[892]: time="2026-10-08T16:12:38.589Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:38.589" grpc.time_ms=0.315 pid=892 span.kind=server system=grpc2106gitlab # [ 248.429287] gitaly[892]: time="2026-10-08T16:12:38.619Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:38.619" grpc.time_ms=0.285 pid=892 span.kind=server system=grpc2107gitlab # [ 248.442907] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1222108gitlab # [ 248.448438] gitaly[892]: time="2026-10-08T16:12:38.638Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J diskcache=00997fe2-7cdb-4f0c-8f00-7e846c14548b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:08.336" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:38.536" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 248.458073] gitaly[892]: time="2026-10-08T16:12:38.648Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7291 command.oublock=0 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:08.336" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:38.536" grpc.time_ms=102.337 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2110gitlab # [ 248.483703] gitaly[892]: time="2026-10-08T16:12:38.674Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGVK4PYED53C60NWT770 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:08.172" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:38.673" grpc.time_ms=0.453 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 248.512686] gitaly[892]: time="2026-10-08T16:12:38.703Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGVK4PYED53C60NWT770 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-08T16:12:48.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:38.697" grpc.time_ms=5.54 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 248.526473] gitaly[892]: time="2026-10-08T16:12:38.716Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:13:08.515" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:38.715" grpc.time_ms=0.928 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 248.549212] gitaly[892]: time="2026-10-08T16:12:38.739Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:08.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:38.738" grpc.time_ms=0.626 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 248.557420] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.747Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"97423e1c73d4b6286bea7b1e","created_at":"2026-10-08T16:12:38.746Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"2f47e06e5ff54d657c41dbb9","job_size_bytes":3,"pid":2487,"job_status":"deduplicated","message":"PipelineProcessWorker JID-97423e1c73d4b6286bea7b1e: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2115gitlab # [ 248.558735] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.749Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2f47e06e5ff54d657c41dbb9","created_at":"2026-10-08T16:12:38.456Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-08c57403a24c4f21","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.459Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2487,"job_status":"rescheduled","message":"PipelineProcessWorker JID-2f47e06e5ff54d657c41dbb9: rescheduled"}2116gitlab # [ 248.559716] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/8f5fa1331c0ec995c36a7ded702dd06b50d31b58 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1062117gitlab # [ 248.563856] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.754Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2f47e06e5ff54d657c41dbb9","created_at":"2026-10-08T16:12:38.456Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-08c57403a24c4f21","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.459Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2f47e06e5ff54d657c41dbb9: done: 0.29266 sec","job_status":"done","queue_duration_s":0.00177,"scheduling_latency_s":0.001809,"gitaly_calls":3,"gitaly_duration_s":0.132326,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025615,"redis_read_bytes":239,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001499,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000977,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.014135,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.005428,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000222,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000432,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001423,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.015,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098987,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.261323437,"duration_s":0.29266,"completed_at":"2026-10-08T16:12:38.754Z","load_balancing_strategy":"primary","db_duration_s":0.035198,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2118gitlab # [ 248.615118] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5e6e457530ff1e2a852a97d1","created_at":"2026-10-08T16:12:38.529Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.531Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5e6e457530ff1e2a852a97d1: start","job_status":"start","queue_duration_s":0.223439,"scheduling_latency_s":0.223453}2119gitlab # [ 248.615721] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.780Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5e6e457530ff1e2a852a97d1","created_at":"2026-10-08T16:12:38.529Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.531Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5e6e457530ff1e2a852a97d1: done: 0.025665 sec","job_status":"done","queue_duration_s":0.223439,"scheduling_latency_s":0.223453,"redis_calls":7,"redis_duration_s":0.0016229999999999999,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025665,"completed_at":"2026-10-08T16:12:38.780Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00548,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2120gitlab # [ 248.658754] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.781Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"425bba1fcf3287bc78aa5b99","created_at":"2026-10-08T16:12:38.664Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.666Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-425bba1fcf3287bc78aa5b99: start","job_status":"start","queue_duration_s":0.115521,"scheduling_latency_s":0.115535}2121gitlab # [ 248.665277] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.796Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"425bba1fcf3287bc78aa5b99","created_at":"2026-10-08T16:12:38.664Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.666Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-425bba1fcf3287bc78aa5b99: done: 0.014838 sec","job_status":"done","queue_duration_s":0.115521,"scheduling_latency_s":0.115535,"redis_calls":7,"redis_duration_s":0.00098,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014838,"completed_at":"2026-10-08T16:12:38.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002401,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2122gitlab # [ 248.737300] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.797Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d33889b0c31775ec1e31b726","created_at":"2026-10-08T16:12:38.670Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.674Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d33889b0c31775ec1e31b726: start","job_status":"start","queue_duration_s":0.123101,"scheduling_latency_s":0.123114}2123gitlab # [ 248.737957] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.812Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d33889b0c31775ec1e31b726","created_at":"2026-10-08T16:12:38.670Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.674Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d33889b0c31775ec1e31b726: done: 0.015406 sec","job_status":"done","queue_duration_s":0.123101,"scheduling_latency_s":0.123114,"redis_calls":7,"redis_duration_s":0.0009400000000000001,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015406,"completed_at":"2026-10-08T16:12:38.812Z","load_balancing_strategy":"primary","db_duration_s":0.002714,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2124gitlab # [ 248.756927] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.813Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"faadb3512b6e848fa13eac3a","created_at":"2026-10-08T16:12:38.692Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.694Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-faadb3512b6e848fa13eac3a: start","job_status":"start","queue_duration_s":0.119726,"scheduling_latency_s":0.11974}2125gitlab # [ 248.771755] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"faadb3512b6e848fa13eac3a","created_at":"2026-10-08T16:12:38.692Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.694Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-faadb3512b6e848fa13eac3a: done: 0.018708 sec","job_status":"done","queue_duration_s":0.119726,"scheduling_latency_s":0.11974,"redis_calls":10,"redis_duration_s":0.001878,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000547,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000626,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018708,"completed_at":"2026-10-08T16:12:38.832Z","load_balancing_strategy":"primary","db_duration_s":0.003737,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2126gitlab # [ 248.820969] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.833Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f2932d12e0d848d93567f9f9","created_at":"2026-10-08T16:12:38.694Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.695Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f2932d12e0d848d93567f9f9: start","job_status":"start","queue_duration_s":0.137986,"scheduling_latency_s":0.137999}2127gitlab # [ 248.829571] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.847Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f2932d12e0d848d93567f9f9","created_at":"2026-10-08T16:12:38.694Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.695Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f2932d12e0d848d93567f9f9: done: 0.01414 sec","job_status":"done","queue_duration_s":0.137986,"scheduling_latency_s":0.137999,"redis_calls":7,"redis_duration_s":0.000926,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01414,"completed_at":"2026-10-08T16:12:38.847Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2128gitlab # [ 248.894212] nixbot[2612]: {"ts": "2026-10-08T16:12:38.986Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 2, "sha": "8f5fa1331c0ec995c36a7ded702dd06b50d31b58", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}2129gitlab # [ 248.894954] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 462130gitlab # [ 248.895614] gitaly[892]: time="2026-10-08T16:12:39.053Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:39.053" grpc.time_ms=0.347 pid=892 span.kind=server system=grpc2131gitlab # [ 248.896715] gitaly[892]: time="2026-10-08T16:12:39.061Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KH77SAVZY15HK631C3HQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.056" grpc.time_ms=5.595 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2132gitlab # [ 248.897453] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7b7531a2f1650271fcbd7ef9","created_at":"2026-10-08T16:12:38.695Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.697Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7b7531a2f1650271fcbd7ef9: start","job_status":"start","queue_duration_s":0.150455,"scheduling_latency_s":0.150468}2133gitlab # [ 248.938730] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.861Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"7b7531a2f1650271fcbd7ef9","created_at":"2026-10-08T16:12:38.695Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.697Z","job_size_bytes":19,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-7b7531a2f1650271fcbd7ef9: done: 0.013362 sec","job_status":"done","queue_duration_s":0.150455,"scheduling_latency_s":0.150468,"redis_calls":8,"redis_duration_s":0.001071,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000823,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013362,"completed_at":"2026-10-08T16:12:38.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 248.948047] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.862Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"09fda5e60ff3ea916965c006","created_at":"2026-10-08T16:12:38.699Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.701Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-09fda5e60ff3ea916965c006: start","job_status":"start","queue_duration_s":0.161153,"scheduling_latency_s":0.16119}2135gitlab # [ 248.964471] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.874Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"09fda5e60ff3ea916965c006","created_at":"2026-10-08T16:12:38.699Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.701Z","job_size_bytes":66,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-09fda5e60ff3ea916965c006: done: 0.012297 sec","job_status":"done","queue_duration_s":0.161153,"scheduling_latency_s":0.16119,"redis_calls":7,"redis_duration_s":0.000908,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000245,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012297,"completed_at":"2026-10-08T16:12:38.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2136gitlab # [ 249.008584] gitaly[892]: time="2026-10-08T16:12:39.088Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3890 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:39.088" grpc.time_ms=0.235 pid=892 span.kind=server system=grpc2137gitlab # [ 249.013596] gitaly[892]: time="2026-10-08T16:12:39.105Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-08T16:12:39.105" grpc.time_ms=0.384 pid=892 span.kind=server system=grpc2138gitlab # [ 249.054629] gitlab-workhorse[822]: time="2026-10-08T16:12:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672139gitlab # [ 249.055535] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1122140gitlab # [ 249.056063] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 432141gitlab # [ 249.056572] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.875Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a01e78d6b3cdc9eb22d98d6b","created_at":"2026-10-08T16:12:38.702Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.703Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a01e78d6b3cdc9eb22d98d6b: start","job_status":"start","queue_duration_s":0.172406,"scheduling_latency_s":0.172419}2142gitlab # [ 249.059238] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.919Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a01e78d6b3cdc9eb22d98d6b","created_at":"2026-10-08T16:12:38.702Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.703Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a01e78d6b3cdc9eb22d98d6b: done: 0.044056 sec","job_status":"done","queue_duration_s":0.172406,"scheduling_latency_s":0.172419,"redis_calls":7,"redis_duration_s":0.000975,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044056,"completed_at":"2026-10-08T16:12:38.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 249.082996] gitaly[892]: time="2026-10-08T16:12:39.151Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J diskcache=6da0a277-9103-463e-9e04-bc99c607e3ab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:09.007" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:39.008" pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2144gitlab # [ 249.124082] gitaly[892]: time="2026-10-08T16:12:39.151Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=61 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7230 command.oublock=0 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=40 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-08T16:13:09.007" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-08T16:12:39.008" grpc.time_ms=143.224 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2145gitlab # [ 249.124767] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.920Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"2e01ef0f542c52eb8f20a091","created_at":"2026-10-08T16:12:38.705Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.706Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2e01ef0f542c52eb8f20a091: start","job_status":"start","queue_duration_s":0.213964,"scheduling_latency_s":0.213979}2146gitlab # [ 249.125495] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.936Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"2e01ef0f542c52eb8f20a091","created_at":"2026-10-08T16:12:38.705Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.706Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2e01ef0f542c52eb8f20a091: done: 0.01538 sec","job_status":"done","queue_duration_s":0.213964,"scheduling_latency_s":0.213979,"redis_calls":7,"redis_duration_s":0.000962,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00071,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01538,"completed_at":"2026-10-08T16:12:38.936Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003615,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2147gitlab # [ 249.165803] gitlab-workhorse[822]: time="2026-10-08T16:12:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672148gitlab # [ 249.166668] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/10/08:16:12:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 422149gitlab # [ 249.167219] gitaly[892]: time="2026-10-08T16:12:39.175Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KH8QC62D8QAM3B1F1GP4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.161" pid=892 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2150gitlab # [ 249.171117] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.936Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6cfff64605136df14d85cde1","created_at":"2026-10-08T16:12:38.707Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.707Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6cfff64605136df14d85cde1: start","job_status":"start","queue_duration_s":0.229062,"scheduling_latency_s":0.229075}2151gitlab # [ 249.214486] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6cfff64605136df14d85cde1","created_at":"2026-10-08T16:12:38.707Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.707Z","job_size_bytes":6,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6cfff64605136df14d85cde1: done: 0.008021 sec","job_status":"done","queue_duration_s":0.229062,"scheduling_latency_s":0.229075,"redis_calls":7,"redis_duration_s":0.0009209999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000243,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.008021,"completed_at":"2026-10-08T16:12:38.944Z","load_balancing_strategy":"primary","db_duration_s":0.000239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2152gitlab # [ 249.261367] gitaly[892]: time="2026-10-08T16:12:39.175Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KH8QC62D8QAM3B1F1GP4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.161" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2153gitlab # [ 249.262100] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.946Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"20c8e8e75327e4006d8c487b","created_at":"2026-10-08T16:12:38.708Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.709Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-20c8e8e75327e4006d8c487b: start","job_status":"start","queue_duration_s":0.237418,"scheduling_latency_s":0.23745}2154gitlab # [ 249.262828] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.961Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"20c8e8e75327e4006d8c487b","created_at":"2026-10-08T16:12:38.708Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.709Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-20c8e8e75327e4006d8c487b: done: 0.015633 sec","job_status":"done","queue_duration_s":0.237418,"scheduling_latency_s":0.23745,"redis_calls":7,"redis_duration_s":0.00102,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015633,"completed_at":"2026-10-08T16:12:38.961Z","load_balancing_strategy":"primary","db_duration_s":0.002003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2155gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses2156gitlab # [ 249.308791] gitaly[892]: time="2026-10-08T16:12:39.175Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KH8QC62D8QAM3B1F1GP4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.161" grpc.time_ms=13.824 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2157gitlab # [ 249.309973] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:38.962Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"6ec523dc1f4ccae8f12cbc18","created_at":"2026-10-08T16:12:38.749Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.750Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6ec523dc1f4ccae8f12cbc18: start","job_status":"start","queue_duration_s":0.211942,"scheduling_latency_s":0.211955}2158gitlab # [ 249.315604] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.225Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"6ec523dc1f4ccae8f12cbc18","created_at":"2026-10-08T16:12:38.749Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-a8b1e3b79e784610","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:38.750Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-6ec523dc1f4ccae8f12cbc18: done: 0.262667 sec","job_status":"done","queue_duration_s":0.211942,"scheduling_latency_s":0.211955,"gitaly_calls":3,"gitaly_duration_s":0.157157,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.01054,"redis_read_bytes":144,"redis_write_bytes":16871,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000355,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000742,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.002621,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11220,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.004903,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000151,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00036,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072219,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.243920666,"duration_s":0.262667,"completed_at":"2026-10-08T16:12:39.225Z","load_balancing_strategy":"primary","db_duration_s":0.024692,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2159gitlab # [ 249.360123] gitaly[892]: time="2026-10-08T16:12:39.196Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-08T16:13:09.195" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:39.195" grpc.time_ms=0.596 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 249.371910] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.226Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"326564ad3b2e8e11302b29fc","created_at":"2026-10-08T16:12:39.001Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-4fdb2a1806564a15","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:39.003Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-326564ad3b2e8e11302b29fc: start","job_status":"start","queue_duration_s":0.22327,"scheduling_latency_s":0.223312}2161gitlab # [ 249.417104] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"326564ad3b2e8e11302b29fc","created_at":"2026-10-08T16:12:39.001Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-4fdb2a1806564a15","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:39.003Z","job_size_bytes":23,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-326564ad3b2e8e11302b29fc: done: 0.029636 sec","job_status":"done","queue_duration_s":0.22327,"scheduling_latency_s":0.223312,"redis_calls":7,"redis_duration_s":0.003365,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029636,"completed_at":"2026-10-08T16:12:39.256Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007008,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2162gitlab # [ 249.461868] gitaly[892]: time="2026-10-08T16:12:39.217Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KGGF3MZPT0VHCDPXN72J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-08T16:13:09.015" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-08T16:12:39.215" grpc.time_ms=1.123 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 249.462640] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.258Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"532fffea61a1a02f2d39ad70","created_at":"2026-10-08T16:12:39.162Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-4fdb2a1806564a15","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:39.164Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-532fffea61a1a02f2d39ad70: start","job_status":"start","queue_duration_s":0.094588,"scheduling_latency_s":0.094603}2164gitlab # [ 249.463405] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.277Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"532fffea61a1a02f2d39ad70","created_at":"2026-10-08T16:12:39.162Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-4fdb2a1806564a15","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:39.164Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-532fffea61a1a02f2d39ad70: done: 0.018835 sec","job_status":"done","queue_duration_s":0.094588,"scheduling_latency_s":0.094603,"redis_calls":7,"redis_duration_s":0.003183,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002622,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000561,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018835,"completed_at":"2026-10-08T16:12:39.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002512,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2165gitlab # [ 249.506924] gitaly[892]: time="2026-10-08T16:12:39.240Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M4E4KHCX18TXV189N547K3J4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.233" grpc.time_ms=7.394 pid=892 remote_ip="2001:db8:1::1" span.kind=server system=grpc2166gitlab # [ 249.507549] gitaly[892]: time="2026-10-08T16:12:39.283Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KHEA095ENYGFB0896E79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.278" pid=892 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2167gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/8f5fa1331c0ec995c36a7ded702dd06b50d31b58/statuses, in 0.23 seconds)2168gitlab # [ 249.511934] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8a087ad6d21c60a33bb76d1c","created_at":"2026-10-08T16:12:39.169Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-4fdb2a1806564a15","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:39.170Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8a087ad6d21c60a33bb76d1c: start","job_status":"start","queue_duration_s":0.107859,"scheduling_latency_s":0.107874}2169(finished: subtest: eval and build post commit statuses, in 5.94 seconds)2170(finished: run the VM test script, in 300.92 seconds)2171gitlab # [ 249.526697] sidekiq-cluster[2487]: {"severity":"INFO","time":"2026-10-08T16:12:39.296Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"8a087ad6d21c60a33bb76d1c","created_at":"2026-10-08T16:12:39.169Z","trace_propagation_headers":{"sentry-trace":"f6736e317ea34cde9ebe82afa2caaaaa-4fdb2a1806564a15","baggage":"sentry-trace_id=f6736e317ea34cde9ebe82afa2caaaaa,sentry-release=Unknown"},"correlation_id":"01M4E4KGGF3MZPT0VHCDPXN72J","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-10-08T16:12:39.170Z","job_size_bytes":3,"pid":2487,"sidekiq_tid":"m7z7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-8a087ad6d21c60a33bb76d1c: done: 0.018279 sec","job_status":"done","queue_duration_s":0.107859,"scheduling_latency_s":0.107874,"redis_calls":7,"redis_duration_s":0.001033,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000272,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018279,"completed_at":"2026-10-08T16:12:39.296Z","load_balancing_strategy":"primary","db_duration_s":0.002709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2172test script finished in 300.97s2173cleanup2174kill QemuMachine (pid 46)2175gitlab # [ 249.605600] gitaly[892]: time="2026-10-08T16:12:39.283Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M4E4KHEA095ENYGFB0896E79 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-08T16:12:39.278" negotiation.command=ls-rqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2176gitlab # e2177(finished: cleanup, in 1.40 seconds)2178additionally exposed symbols:2179 gitlab,2180 vlan1,2181 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2182[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-08T16:11:47.295Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2183[]2184[]2185[]2186[]2187[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-08T16:12:31.773495Z', 'started_at': '2026-10-08T16:12:31.992545Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2188[{'id': 5, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-08T16:12:31.968Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2189[{'id': 5, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-08T16:12:31.968Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2190[{'id': 5, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-08T16:12:31.968Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2191[{'id': 5, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-08T16:12:31.968Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2192[{'id': 5, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-10-08T16:12:31.968Z', 'started_at': None, 'finished_at': '2026-10-08T16:12:38.445Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2193[{'id': 5, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 6s (1 warning)', 'created_at': '2026-10-08T16:12:31.968Z', 'started_at': None, 'finished_at': '2026-10-08T16:12:38.445Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '8f5fa1331c0ec995c36a7ded702dd06b50d31b58', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-08T16:12:38.617Z', 'started_at': None, 'finished_at': '2026-10-08T16:12:38.732Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]