vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #463
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.XjOQHBg14e', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 66.63 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab # Filesystem UUID: ac43f844-2f86-450d-a2a9-eaf1da9b868417gitlab # Superblock backups stored on blocks:18gitlab # 32768, 98304, 163840, 22937619gitlab: waiting for unit setup-gitlab.service20gitlab # 21gitlab: waiting for the VM to finish booting22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cgd1yl65d8jhhgrvmdy0k8gxib2lrcsw-nixos-system-gitlab-test/init regInfo=/nix/store/4f03cb9ji3513blm8jy2zm8zn8597npb-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 512283835 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.008 MHz processor67gitlab # [ 0.000813] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000879] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002738] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002749] Using GB pages for direct mapping73gitlab # [ 0.002803] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002812] ACPI: Early table checksum verification disabled75gitlab # [ 0.002815] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002818] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002822] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002828] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002830] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002832] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002833] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002835] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002836] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002837] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002838] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002838] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002839] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002839] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003070] No NUMA configuration found90gitlab # [ 0.003071] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003074] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005451] Zone ranges:93gitlab # [ 0.005452] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005454] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005455] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005456] Device empty97gitlab # [ 0.005456] Movable zone start for each node98gitlab # [ 0.005457] Early memory node ranges99gitlab # [ 0.005457] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005458] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005459] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005460] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005480] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005762] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.117159] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.117583] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.117597] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.117628] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.117630] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.117632] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.117633] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.117634] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.117635] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.117638] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.117639] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.117643] TSC deadline timer available117gitlab # [ 0.117648] CPU topo: Max. logical packages: 1118gitlab # [ 0.117649] CPU topo: Max. logical dies: 1119gitlab # [ 0.117649] CPU topo: Max. dies per package: 1120gitlab # [ 0.117652] CPU topo: Max. threads per core: 1121gitlab # [ 0.117653] CPU topo: Num. cores per package: 4122gitlab # [ 0.117653] CPU topo: Num. threads per package: 4123gitlab # [ 0.117654] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.117675] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.117700] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.117702] kvm-guest: setup PV sched yield127gitlab # [ 0.117719] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.117720] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.117721] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.117723] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.117725] Booting paravirtualized kernel on KVM132gitlab # [ 0.117728] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.122180] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.124455] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.124505] kvm-guest: PV spinlocks enabled136gitlab # [ 0.124506] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.124509] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cgd1yl65d8jhhgrvmdy0k8gxib2lrcsw-nixos-system-gitlab-test/init regInfo=/nix/store/4f03cb9ji3513blm8jy2zm8zn8597npb-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.124604] Unknown kernel command line parameters "regInfo=/nix/store/4f03cb9ji3513blm8jy2zm8zn8597npb-closure-info/registration", will be passed to user space.139gitlab # [ 0.124617] random: crng init done140gitlab # [ 0.124618] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.133867] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.138583] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.138659] software IO TLB: area num 4.144gitlab # [ 0.211087] Fallback order for Node 0: 0145gitlab # [ 0.211094] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.211096] Policy zone: Normal147gitlab # [ 0.213548] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.223224] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.237107] allocated 12582912 bytes of page_ext150gitlab # [ 0.247189] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.247191] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.248113] Dynamic Preempt: lazy153gitlab # [ 0.248298] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.248298] rcu: RCU event tracing is enabled.155gitlab # [ 0.248299] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.248301] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.248301] Rude variant of Tasks RCU enabled.158gitlab # [ 0.248301] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.248302] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.248303] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.248330] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.248332] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.248333] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.252810] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.253149] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.253156] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.253271] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.256865] Console: colour VGA+ 80x25169gitlab # [ 0.256868] printk: legacy console [tty0] enabled170gitlab # [ 0.287577] printk: legacy console [ttyS0] enabled171gitlab # [ 0.398935] ACPI: Core revision 20250807172gitlab # [ 0.399858] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.401485] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.402563] x2apic enabled175gitlab # [ 0.403312] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.404269] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.405616] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.407126] kvm-guest: setup PV IPIs179gitlab # [ 0.408736] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.409817] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns181gitlab # [ 0.411647] Calibrating delay loop (skipped) preset value.. 4800.01 BogoMIPS (lpj=2400008)182gitlab # [ 0.412729] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.414672] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.416644] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.417649] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.419645] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.420645] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.421644] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.422645] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.423644] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.424652] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.426275] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.427645] active return thunk: srso_alias_return_thunk194gitlab # [ 0.428675] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.429644] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.430644] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.431644] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.433500] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.434491] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.435644] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.436644] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.437644] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.438644] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.439644] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.441465] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.442472] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.471996] Freeing SMP alternatives memory: 44K208gitlab # [ 0.472647] pid_max: default: 32768 minimum: 301209gitlab # [ 0.473747] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.474756] landlock: Up and running.211gitlab # [ 0.475645] Yama: becoming mindful.212gitlab # [ 0.476495] LSM support for eBPF active213gitlab # [ 0.477370] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.478798] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.481591] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.482183] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.482649] ... version: 2218gitlab # [ 0.483406] ... bit width: 48219gitlab # [ 0.483647] ... generic counters: 6220gitlab # [ 0.484421] ... generic bitmap: 000000000000003f221gitlab # [ 0.484693] ... fixed-purpose counters: 0222gitlab # [ 0.485491] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.486424] ... value mask: 0000ffffffffffff224gitlab # [ 0.486646] ... max period: 00007fffffffffff225gitlab # [ 0.487626] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.488549] signal: max sigframe size: 3376227gitlab # [ 0.489300] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.489650] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.490759] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.496170] smp: Bringing up secondary CPUs ...231gitlab # [ 0.497419] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.497656] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.500711] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.502204] smpboot: Total of 4 processors activated (19200.06 BogoMIPS)235gitlab # [ 0.502923] Memory: 6011496K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.503974] devtmpfs: initialized237gitlab # [ 0.504827] x86/mm: Memory block size: 128MB238gitlab # [ 0.507689] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.508733] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.509743] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.510915] PM: RTC time: 22:08:50, date: 2026-10-21242gitlab # [ 0.514560] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.516947] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.517699] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.519997] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.520662] audit: initializing netlink subsys (disabled)247gitlab # [ 0.521756] audit: type=2000 audit(1792620530.609:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.521912] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.523647] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.524647] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.525647] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.526646] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.527670] cpuidle: using governor menu254gitlab # [ 0.529846] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.530950] PCI: Using configuration type 1 for base access256gitlab # [ 0.531648] PCI: Using configuration type 1 for extended access257gitlab # [ 0.532781] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.535692] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.536648] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.537647] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.538647] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.543297] ACPI: Added _OSI(Module Device)263gitlab # [ 0.545655] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.547653] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.554667] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.559894] ACPI: Interpreter enabled267gitlab # [ 0.560736] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.562658] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.564835] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.568652] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.571155] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.584686] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.586659] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.590619] acpiphp: Slot [3] registered275gitlab # [ 0.591740] acpiphp: Slot [4] registered276gitlab # [ 0.592735] acpiphp: Slot [5] registered277gitlab # [ 0.594730] acpiphp: Slot [6] registered278gitlab # [ 0.595762] acpiphp: Slot [7] registered279gitlab # [ 0.597730] acpiphp: Slot [8] registered280gitlab # [ 0.598720] acpiphp: Slot [9] registered281gitlab # [ 0.600726] acpiphp: Slot [10] registered282gitlab # [ 0.601745] acpiphp: Slot [11] registered283gitlab # [ 0.603740] acpiphp: Slot [12] registered284gitlab # [ 0.604718] acpiphp: Slot [13] registered285gitlab # [ 0.606741] acpiphp: Slot [14] registered286gitlab # [ 0.607708] acpiphp: Slot [15] registered287gitlab # [ 0.609692] acpiphp: Slot [16] registered288gitlab # [ 0.610660] acpiphp: Slot [17] registered289gitlab # [ 0.611407] acpiphp: Slot [18] registered290gitlab # [ 0.611667] acpiphp: Slot [19] registered291gitlab # [ 0.612430] acpiphp: Slot [20] registered292gitlab # [ 0.613666] acpiphp: Slot [21] registered293gitlab # [ 0.614427] acpiphp: Slot [22] registered294gitlab # [ 0.614667] acpiphp: Slot [23] registered295gitlab # [ 0.615416] acpiphp: Slot [24] registered296gitlab # [ 0.616667] acpiphp: Slot [25] registered297gitlab # [ 0.617423] acpiphp: Slot [26] registered298gitlab # [ 0.617667] acpiphp: Slot [27] registered299gitlab # [ 0.618435] acpiphp: Slot [28] registered300gitlab # [ 0.619666] acpiphp: Slot [29] registered301gitlab # [ 0.620409] acpiphp: Slot [30] registered302gitlab # [ 0.620667] acpiphp: Slot [31] registered303gitlab # [ 0.621429] PCI host bridge to bus 0000:00304gitlab # [ 0.622656] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.623647] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.624647] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.625647] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.627664] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.628659] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.630052] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.632277] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.634144] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.637664] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.638623] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.639555] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.641496] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.642582] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.643689] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.646709] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.648826] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.649922] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.651654] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.652873] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.667744] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.669660] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.670674] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.671812] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.673414] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.678689] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.679653] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.680669] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.693654] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.700235] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.711692] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.713669] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.716707] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.722777] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.733694] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.735668] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.737706] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.744744] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.752687] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.753662] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.755694] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.760328] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.765687] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.766625] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.767476] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.771527] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.778705] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.780690] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.782696] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.788100] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.793687] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.795663] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.796694] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.799653] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.801946] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.804659] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.805694] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.808883] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.812838] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.814654] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.815669] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.817889] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.821517] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.822360] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.823995] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.834097] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.837005] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.838928] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.841917] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.843802] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.848672] iommu: Default domain type: Translated375gitlab # [ 0.849650] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.853680] ACPI: bus type USB registered377gitlab # [ 0.854759] usbcore: registered new interface driver usbfs378gitlab # [ 0.856771] usbcore: registered new interface driver hub379gitlab # [ 0.858673] usbcore: registered new device driver usb380gitlab # [ 0.861833] NetLabel: Initializing381gitlab # [ 0.863651] NetLabel: domain hash size = 128382gitlab # [ 0.864650] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.866748] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.868667] PCI: Using ACPI for IRQ routing385gitlab # [ 0.871196] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.871643] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.871643] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.875650] vgaarb: loaded389gitlab # [ 0.876422] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.876647] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.881716] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.883263] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.884043] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.885540] pnp: PnP ACPI init395gitlab # [ 0.886714] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.896272] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.900046] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.902784] NET: Registered PF_INET protocol family399gitlab # [ 0.907891] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.935942] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.937534] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.939000] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.942879] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.944293] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.945545] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.946939] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.948154] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.949591] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.950664] NET: Registered PF_XDP protocol family410gitlab # [ 0.951556] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.952647] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.953713] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.954911] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.956090] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.957533] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.958584] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.961037] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.963658] PCI: CLS 0 bytes, default 64419gitlab # [ 0.964456] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.964674] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.964698] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.968105] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x22983f10a64, max_idle_ns: 440795218721 ns423gitlab # [ 0.989123] Initialise system trusted keyrings424gitlab # [ 0.990482] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 1.001927] Key type asymmetric registered426gitlab # [ 1.002725] Asymmetric key parser 'x509' registered427gitlab # [ 1.003670] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 1.005298] io scheduler mq-deadline registered429gitlab # [ 1.006147] io scheduler kyber registered430gitlab # [ 1.010841] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.012201] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.014841] Linux agpgart interface v0.103433gitlab # [ 1.015658] ACPI: bus type drm_connector registered434gitlab # [ 1.018824] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.019965] usbserial: USB Serial support registered for generic436gitlab # [ 1.021027] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.021027] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.023442] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.024967] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.026199] NET: Registered PF_INET6 protocol family441gitlab # [ 1.028007] Segment Routing with IPv6442gitlab # [ 1.028707] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.030771] IPI shorthand broadcast: enabled444gitlab # [ 1.035141] sched_clock: Marking stable (884011120, 150487316)->(1058212441, -23714005)445gitlab # [ 1.037014] registered taskstats version 1446gitlab # [ 1.038080] Loading compiled-in X.509 certificates447gitlab # [ 1.048054] Demotion targets for Node 0: null448gitlab # [ 1.049183] Key type .fscrypt registered449gitlab # [ 1.049936] Key type fscrypt-provisioning registered450gitlab # [ 1.050941] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.051917] ima: Allocated hash algorithm: sha1452gitlab # [ 1.052793] ima: No architecture policies found453gitlab # [ 1.053830] PM: Magic number: 14:4:149454gitlab # [ 1.055482] RAS: Correctable Errors collector initialized.455gitlab # [ 1.060009] clk: Disabling unused clocks456gitlab # [ 1.060746] PM: genpd: Disabling unused power domains457gitlab # [ 1.236700] Freeing initrd memory: 29392K458gitlab # [ 1.240175] Freeing unused decrypted memory: 2028K459gitlab # [ 1.243002] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.244149] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.246307] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.248019] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.300300] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.301478] Run /init as init process465gitlab # [ 1.312873] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.334859] fuse: init (API version 7.45)467gitlab # [ 1.343296] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.350426] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.354035] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.395852] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.731623] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.748251] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.749157] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.750079] systemd[1]: Running in initrd.475gitlab # [ 1.751172] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.752409] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.849878] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.890633] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.902038] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.903289] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.904878] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.906106] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.907249] systemd[1]: Reached target Path Units.484gitlab # [ 1.908166] systemd[1]: Reached target Slice Units.485gitlab # [ 1.909110] systemd[1]: Reached target Swaps.486gitlab # [ 1.909976] systemd[1]: Reached target Timer Units.487gitlab # [ 1.910996] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.912265] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.913451] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.914540] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.915617] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.916598] systemd[1]: Reached target Socket Units.493gitlab # [ 1.918573] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.920649] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.922682] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 1.925376] systemd[1]: Starting Journal Service...497gitlab # [ 1.934338] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 1.935430] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 1.943733] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 1.954892] systemd[1]: modprobe@configfs.service: Deactivated successfully.501gitlab # [ 1.956509] systemd[1]: Finished Load Kernel Module configfs.502gitlab # [ 1.961322] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.503gitlab # [ 1.964910] systemd[1]: Finished Create List of Static Device Nodes.504gitlab # [ 1.966133] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev505gitlab # [ 1.966350] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config506gitlab # [ 1.971750] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...507gitlab # [ 1.988375] systemd-journald[90]: Collecting audit messages is disabled.508gitlab # [ 1.991706] netfs: FS-Cache loaded509gitlab # [ 1.992672] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.510gitlab # [ 1.994723] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 1.999157] 9pnet: Installing 9P2000 support512gitlab # [ 1.999334] systemd[1]: Starting Apply Kernel Variables...513gitlab # [ 2.006047] systemd[1]: Starting Create Static Device Nodes in /dev...514gitlab # [ 2.007925] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.515gitlab # [ 2.012931] systemd[1]: Finished Load Kernel Module 9pnet_virtio.516gitlab # [ 2.021504] systemd[1]: Finished Apply Kernel Variables.517gitlab # [ 2.023362] systemd[1]: Finished Create Static Device Nodes in /dev.518gitlab # [ 2.024756] systemd[1]: Reached target Preparation for Local File Systems.519gitlab # [ 1.875078] s[ 2.026008] systemd[1]: Reached target Local File Systems.520gitlab # ystemd-modules-load[92]: Using 4 probe threads521gitlab # [ 1.877378] systemd-modules-load[92]: Inserted module 'dm_mod'[ 2.028199] systemd[1]: Starting Rule-based Manager for Device Events and Files...522gitlab # 523gitlab # [ 1.879279] s[ 2.029603] systemd[1]: Started Journal Service.524gitlab # ystemd-modules-load[92]: Inserted module 'virtio_balloon'525gitlab # [ 1.880949] systemd-modules-load[92]: Inserted module 'virtio_gpu'526gitlab # [ 1.887391] systemd[1]: Starting Create System Files and Directories...527gitlab # [ 1.898674] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.904132] systemd-udevd[105]: Using default interface naming scheme 'v261'.529gitlab # [ 1.914352] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 1.934876] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 1.935775] systemd[1]: Reached target System Initialization.532gitlab # [ 1.936620] systemd[1]: Reached target Basic System.533gitlab # [ 2.164758] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.165571] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.166678] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.167546] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.168652] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.169871] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.170985] virtio_blk virtio4: 4/0/0 default/read/poll queues540gitlab # [ 2.171046] usb usb1: Product: UHCI Host Controller541gitlab # [ 2.172596] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd542gitlab # [ 2.173396] usb usb1: SerialNumber: 0000:00:01.2543gitlab # [ 2.176391] hub 1-0:1.0: USB hub found544gitlab # [ 2.177231] hub 1-0:1.0: 2 ports detected545gitlab # [ 2.177438] SCSI subsystem initialized546gitlab # [ 2.180829] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)547gitlab # [ 2.194346] virtio_blk virtio5: 4/0/0 default/read/poll queues548gitlab # [ 2.198170] virtio_blk virtio5: [vdb] 11953280 512-byte logical blocks (6.12 GB/5.70 GiB)549gitlab # [ 2.212909] scsi host0: ata_piix550gitlab # [ 2.212950] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12551gitlab # [ 2.213462] scsi host1: ata_piix552gitlab # [ 2.215695] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0553gitlab # [ 2.216794] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0554gitlab # [ 2.218397] serio: i8042 KBD port at 0x60,0x64 irq 1555gitlab # [ 2.220242] serio: i8042 AUX port at 0x60,0x64 irq 12556gitlab # [ 2.093990] (udev-worker)[133]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.557gitlab # [ 2.096373] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line.558gitlab # [ 2.097799] systemd[1]: Starting Virtual Console Setup...559gitlab # [ 2.106347] (udev-worker)[139]: Network interface NamePolicy= disabled on kernel command line.560gitlab # [ 2.114609] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.116506] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.121025] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.122116] systemd[1]: Found device /dev/disk/by-label/nix-store.564gitlab # [ 2.124341] systemd-vconsole-setup[150]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.136594] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.152073] systemd-fsck[157]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.155207] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.379879] ata2: found unknown device (class 0)569gitlab # [ 2.382954] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100570gitlab # [ 2.387314] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5571gitlab # [ 2.396618] usb 1-1: new full-speed USB device number 2 using uhci_hcd572gitlab # [ 2.421335] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.452892] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.480203] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.566612] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.569027] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.571235] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.572634] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.573845] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.589789] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.597926] usbcore: registered new interface driver usbhid582gitlab # [ 2.598891] usbhid: USB HID core driver583gitlab # [ 2.606324] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.608602] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.798684] systemd[1]: Mounting /sysroot...586gitlab # [ 3.101697] EXT4-fs (vda): mounted filesystem ac43f844-2f86-450d-a2a9-eaf1da9b8684 r/w with ordered data mode. Quota mode: none.587gitlab # [ 2.958558] systemd[1]: Mounted /sysroot.588gitlab # [ 2.960365] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 2.963985] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 2.966374] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 2.976301] systemd[1]: Mounting /sysroot/run...592gitlab # [ 2.979141] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 2.987299] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.140576] 9p: Installing v9fs 9p2000 file system support595gitlab # [ 2.997236] systemd[1]: Starting Mountpoints Configured in the Real Root...596gitlab # [ 3.151033] erofs (device vdb): mounted with root inode @ nid 128.597gitlab # [ 3.001469] systemd[1]: Mounted /sysroot/nix/.rw-store.598gitlab # [ 3.003940] systemd[1]: Mounted /sysroot/run.599gitlab # [ 3.005393] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 3.007847] systemd-sysroot-fstab-check[179]: /sysroot should be mounted in the initrd, will request daemon-reload.601gitlab # [ 3.010592] systemd[1]: Starting rw-sysroot-nix-store.service...602gitlab # [ 3.012172] systemd[1]: Mounted /sysroot/nix/.ro-store.603gitlab # [ 3.014771] systemd[1]: Mounted /sysroot/tmp/xchg.604gitlab # [ 3.016233] systemd[1]: Reload requested from client PID 179 ('systemd-sysroot') (unit initrd-parse-etc.service)...605gitlab # [ 3.017941] systemd[1]: Reloading...606gitlab # [ 3.072811] systemd[1]: Reloading finished in 55 ms.607gitlab # [ 3.097177] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.608gitlab # [ 3.099695] systemd-sysroot-fstab-check[179]: Requesting initrd-fs.target/start/replace...609gitlab # [ 3.102381] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.104312] systemd-sysroot-fstab-check[179]: Requesting swap.target/start/replace...611gitlab # [ 3.106806] systemd[1]: Starting rw-sysroot-nix-store.service...612gitlab # [ 3.111368] systemd[1]: initrd-parse-etc.service: Deactivated successfully.613gitlab # [ 3.113534] systemd[1]: Finished Mountpoints Configured in the Real Root.614gitlab # [ 3.115559] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.615gitlab # [ 3.121336] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.123524] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.798438] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.843884] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.845765] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.847643] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.849529] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.863766] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.867687] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 3.883052] systemd[1]: Finished Find NixOS closure.625gitlab # [ 3.884799] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 3.886784] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 3.919135] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 3.921136] systemd[1]: Stopped target Basic System.629gitlab # [ 3.922860] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 3.924717] systemd[1]: Stopped target Path Units.631gitlab # [ 3.926362] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 3.929169] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 3.931704] systemd[1]: Stopped target Slice Units.634gitlab # [ 3.935500] systemd[1]: Stopped target Socket Units.635gitlab # [ 3.937561] systemd[1]: Stopped target System Initialization.636gitlab # [ 3.939873] systemd[1]: Stopped target Swaps.637gitlab # [ 3.943173] systemd[1]: Stopped target Timer Units.638gitlab # [ 3.945675] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 3.947939] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 3.949896] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 3.952313] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 3.953927] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 3.957366] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 3.959277] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 3.961123] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 3.962581] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 3.964468] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 3.965930] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 3.968055] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 3.970044] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 3.971855] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 3.973426] systemd[1]: Stopped target Local File Systems.653gitlab # [ 3.974787] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 3.976257] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 3.977154] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 3.977914] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 3.978941] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 3.979895] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 3.980667] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 3.981611] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 3.982479] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 3.983522] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 3.984300] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 3.985184] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 3.986166] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 3.987126] systemd[1]: Closed udev Control Socket.667gitlab # [ 3.987834] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 3.988609] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 3.989596] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 3.990431] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 3.991514] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 3.992513] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 3.993427] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.005709] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.006811] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.007545] systemd[1]: Reached target Switch Root.677gitlab # [ 4.009081] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.129627] initrd-nixos-activation-start[225]: booting system configuration /nix/store/cgd1yl65d8jhhgrvmdy0k8gxib2lrcsw-nixos-system-gitlab-test679gitlab # [ 4.167759] initrd-nixos-activation-start[225]: running activation script...680gitlab # [ 4.399670] initrd-nixos-activation-start[248]: setting up /etc...681gitlab # [ 4.479758] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.482979] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.485261] systemd[1]: Starting Switch Root...684gitlab # [ 4.512938] systemd[1]: Switching root.685gitlab # [ 4.721068] systemd-journald[90]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.824140] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.189932] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.199826] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.201697] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.203720] systemd[1]: Detected first boot.691gitlab # [ 5.206402] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.341143] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.427647] systemd[1]: Applying preset policy.694gitlab # [ 5.534438] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.631426] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.633088] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.635298] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.637423] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.638839] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.640341] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.641319] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.642633] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.643748] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.644505] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.645286] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.646165] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.646970] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.647813] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.648687] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.649626] systemd[1]: Reached target Path Units.711gitlab # [ 5.650348] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.651183] systemd[1]: Reached target Slice Units.713gitlab # [ 5.651954] systemd[1]: Reached target Swaps.714gitlab # [ 5.653334] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.655305] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.656742] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.658449] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.659452] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.661815] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.663279] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.665159] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.666351] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.667543] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.668901] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.671754] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.673399] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.674324] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.677312] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.679382] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.681394] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.684690] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.694908] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.695955] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.699746] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.731851] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.737298] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.741641] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.749109] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.751160] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.766940] systemd[1]: Starting Journal Service...741gitlab # [ 5.770587] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.785071] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.790002] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.792653] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 5.804613] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 5.812687] loop: module loaded747gitlab # [ 5.814333] systemd-journald[319]: Collecting audit messages is enabled.748gitlab # [ 5.817438] systemd[1]: Listening on Journal Log Access Socket.749gitlab # [ 5.819624] systemd[1]: Mounted Huge Pages File System.750gitlab # [ 5.819741] EXT4-fs (vda): re-mounted ac43f844-2f86-450d-a2a9-eaf1da9b8684.751gitlab # [ 5.820331] systemd[1]: Mounted POSIX Message Queue File System.752gitlab # [ 5.826373] systemd[1]: Mounted Kernel Debug File System.753gitlab # [ 5.827361] systemd[1]: Mounted Kernel Trace File System.754gitlab # [ 5.828347] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.755gitlab # [ 5.830050] systemd[1]: Finished Create List of Static Device Nodes.756gitlab # [ 5.831518] systemd[1]: modprobe@configfs.service: Deactivated successfully.757gitlab # [ 5.833080] systemd[1]: Finished Load Kernel Module configfs.758gitlab # [ 5.834293] systemd[1]: Mounted FUSE Control File System.759gitlab # [ 5.685128] systemd[1]: Queued start job for default target Multi-User System.760gitlab # [ 5.686352] systemd[1]: Unnecessary job was removed for /dev/vdb.761gitlab # [ 5.836686] systemd[1]: Finished Load Kernel Modules.762gitlab # [ 5.687505] systemd[1]: systemd-journald.service: Deactivated successfully.763gitlab # [ 5.688952] systemd-modules-load[320]: Using 3 probe threads764gitlab # [ 5.839277] systemd[1]: Started Journal Service.765gitlab # [ 5.690073] systemd-modules-load[320]: Inserted module 'loop'766gitlab # [ 5.691187] systemd-modules-load[320]: Inserted module 'tls'767gitlab # [ 5.692316] systemd-oomd[322]: No swap; memory pressure usage will be degraded768gitlab # [ 5.693908] systemd[1]: Finished Remount Root and Kernel File Systems.769gitlab # [ 5.699798] systemd[1]: Listening on Disk Image Download Service Socket.770gitlab # [ 5.701904] systemd[1]: Mounting Kernel Configuration File System...771gitlab # [ 5.704559] systemd[1]: Starting Firewall...772gitlab # [ 5.706133] systemd[1]: Starting Flush Journal to Persistent Storage...773gitlab # [ 5.707223] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore774gitlab # [ 5.713319] systemd[1]: Starting Load/Save OS Random Seed...775gitlab # [ 5.717094] systemd[1]: Starting Apply Kernel Variables...776gitlab # [ 5.870726] systemd-journald[319]: Received client request to flush runtime journal.777gitlab # [ 5.757586] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...778gitlab # [ 5.759032] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os779gitlab # [ 5.760440] systemd[1]: Mounted Kernel Configuration File System.780gitlab # [ 5.761567] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.762637] systemd[1]: Reached target First Boot Complete.782gitlab # [ 5.763591] systemd[1]: Finished Apply Kernel Variables.783gitlab # [ 5.764440] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 5.765477] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 5.766417] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 5.767326] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 5.768252] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 5.769223] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 5.790887] systemd-udevd[357]: Using default interface naming scheme 'v261'.790gitlab # [ 5.818816] systemd[1]: Started Rule-based Manager for Device Events and Files.791gitlab # [ 5.821763] systemd[1]: Finished Coldplug All udev Devices.792gitlab # [ 5.897719] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 5.911847] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.794gitlab # [ 5.958658] (udev-worker)[428]: Network interface NamePolicy= disabled on kernel command line.795gitlab # [ 5.971519] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.796gitlab # [ 5.979873] (udev-worker)[427]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.797gitlab # [ 5.982080] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.140135] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3799gitlab # [ 6.161807] ACPI: button: Power Button [PWRF]800gitlab # [ 6.163262] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0801gitlab # [ 6.164515] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD802gitlab # [ 6.027076] systemd[1]: Finished Firewall.803gitlab # [ 6.029742] systemd[1]: Condition check resulted in Virtio network device being skipped.804gitlab # [ 6.031035] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore805gitlab # [ 6.032634] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67806gitlab # [ 6.035152] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore807gitlab # [ 6.037143] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os808gitlab # [ 6.038560] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os809gitlab # [ 6.193826] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console810gitlab # [ 6.198709] rtc_cmos 00:05: RTC can wake from S4811gitlab # [ 6.199097] parport_pc 00:03: reported by Plug and Play ACPI812gitlab # [ 6.199200] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]813gitlab # [ 6.209533] mousedev: PS/2 mouse device common for all mice814gitlab # [ 6.211993] Console: switching to colour dummy device 80x25815gitlab # [ 6.217925] rtc_cmos 00:05: registered as rtc0816gitlab # [ 6.218008] rtc_cmos 00:05: setting system clock to 2026-10-21T22:08:55 UTC (1792620535)817gitlab # [ 6.218107] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs818gitlab # [ 6.220139] systemd-journald[319]: Time jumped backwards, rotating.819gitlab # [ 6.221319] [drm] Found bochs VGA, ID 0xb0c5.820gitlab # [ 6.224719] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.821gitlab # [ 6.225729] Floppy drive(s): fd0 is 2.88M AMI BIOS822gitlab # [ 6.228646] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic823gitlab # [ 6.229792] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0824gitlab # [ 6.229842] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4825gitlab # [ 6.232384] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6826gitlab # [ 6.240868] FDC 0 is a S82078B827gitlab # [ 6.244700] Console: switching to colour frame buffer device 160x50828gitlab # [ 6.246767] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device829gitlab # [ 6.256828] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5830gitlab # [ 6.148265] systemd[1]: Starting Virtual Console Setup...831gitlab # [ 6.153956] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.832gitlab # [ 6.155272] systemd[1]: Stopped Virtual Console Setup.833gitlab # [ 6.156382] systemd[1]: Starting Virtual Console Setup...834gitlab # [ 6.314034] ppdev: user-space parallel port driver835gitlab # [ 6.210343] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.836gitlab # [ 6.212508] systemd[1]: Stopped Virtual Console Setup.837gitlab # [ 6.219156] systemd[1]: Starting Virtual Console Setup...838gitlab # [ 6.384599] kvm_amd: TSC scaling supported839gitlab # [ 6.385073] kvm_amd: Nested Virtualization enabled840gitlab # [ 6.385636] kvm_amd: Nested Paging enabled841gitlab # [ 6.386105] kvm_amd: LBR virtualization supported842gitlab # [ 6.386645] kvm_amd: Virtual VMLOAD VMSAVE supported843gitlab # [ 6.387203] kvm_amd: Virtual GIF supported844gitlab # [ 6.387204] kvm_amd: Virtual NMI enabled845gitlab # [ 6.253057] systemd-vconsole-setup[495]: Configuration of first virtual console was skipped, ignoring remaining ones.846gitlab # [ 6.255834] systemd[1]: Finished Virtual Console Setup.847gitlab # [ 6.422937] EDAC MC: Ver: 3.0.0848gitlab # [ 6.485884] systemd[1]: Mounting /run/wrappers...849gitlab # [ 6.515149] systemd[1]: Mounted /run/wrappers.850gitlab # [ 6.517718] systemd[1]: Reached target Local File Systems.851gitlab # [ 6.520922] systemd[1]: Listening on Boot Loader Control Service Socket.852gitlab # [ 6.525521] systemd[1]: Starting register-nix-paths.service...853gitlab # [ 6.529713] systemd[1]: Starting Create SUID/SGID Wrappers...854gitlab # [ 6.532066] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.855gitlab # [ 6.537336] systemd[1]: Starting Save Transient machine-id to Disk...856gitlab # [ 6.542212] systemd[1]: Starting Create System Files and Directories...857gitlab # [ 6.572108] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858gitlab # [ 6.574481] systemd[1]: Finished Save Transient machine-id to Disk.859gitlab # [ 6.594212] systemd[1]: Finished Create System Files and Directories.860gitlab # [ 6.599071] systemd[1]: Starting Rebuild Journal Catalog...861gitlab # [ 6.600712] systemd[1]: Starting Record System Boot/Shutdown in UTMP...862gitlab # [ 6.618525] systemd[1]: Finished Record System Boot/Shutdown in UTMP.863gitlab # [ 6.634551] systemd[1]: Finished Rebuild Journal Catalog.864gitlab # [ 6.636559] systemd[1]: Starting Update is Completed...865gitlab # [ 6.653287] systemd[1]: Finished Update is Completed.866gitlab # [ 6.687724] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.867gitlab # [ 6.689311] systemd[1]: Finished Create SUID/SGID Wrappers.868gitlab # [ 6.905821] systemd[1]: Finished register-nix-paths.service.869gitlab # [ 6.906945] systemd[1]: Reached target System Initialization.870gitlab # [ 6.907989] systemd[1]: Started Discard unused filesystem blocks once a week.871gitlab # [ 6.909224] systemd[1]: Started logrotate.timer.872gitlab # [ 6.910094] systemd[1]: Started Daily Cleanup of Temporary Directories.873gitlab # [ 6.911217] systemd[1]: Reached target Timer Units.874gitlab # [ 6.912088] systemd[1]: Listening on D-Bus System Message Bus Socket.875gitlab # [ 6.913244] systemd[1]: Listening on Nix Daemon Socket.876gitlab # [ 6.917501] systemd[1]: Starting nixbot CI service socket...877gitlab # [ 6.918576] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.878gitlab # [ 6.920099] systemd[1]: Listening on nixbot CI service socket.879gitlab # [ 6.921177] systemd[1]: Reached target Socket Units.880gitlab # [ 6.923440] systemd[1]: Starting D-Bus System Message Bus...881gitlab # [ 6.960224] dbus-broker-launch[577]: Looking up NSS user entry for 'systemd-timesync'...882gitlab # [ 6.961943] dbus-broker-launch[577]: NSS returned no entry for 'systemd-timesync'883gitlab # [ 6.963406] dbus-broker-launch[577]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"884gitlab # [ 6.967658] systemd[1]: Started D-Bus System Message Bus.885gitlab # [ 6.988337] dbus-broker-launch[577]: Ready886gitlab # [ 6.991278] systemd[1]: Reached target Basic System.887gitlab # [ 6.993960] systemd[1]: Started backdoor.service.888gitlab # [ 6.996597] systemd[1]: Starting gitlab-config.service...889gitlab # [ 7.004297] systemd[1]: Starting Import lastlog data into lastlog2 database...890gitlab # [ 7.008537] systemd[1]: Starting Logrotate configuration check...891gitlab # [ 7.012635] systemd[1]: Starting Name Service Cache Daemon (nsncd)...892gitlab # [ 7.016109] systemd[1]: Starting Post-Boot Actions...893gitlab # [ 7.019600] systemd[1]: Started Reset console on configuration changes.894gitlab # [ 7.024106] systemd[1]: Starting resolvconf update...895gitlab # [ 7.029450] logrotate[582]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.896gitlab # [ 7.031537] logrotate[582]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf897gitlab # connecting to host...898gitlab # [ 7.033085] logrotate[582]: note: 'monthly' overrides previously specified 'weekly'899gitlab # [ 7.034257] logrotate[582]: Reading state from file: /var/lib/logrotate.status900gitlab # [ 7.035320] logrotate[582]: state file /var/lib/logrotate.status does not exist901gitlab # [ 7.036350] logrotate[582]: Allocating hash table for state file, size 64 entries902gitlab # [ 7.037377] logrotate[582]: Handling 4 logs903gitlab # [ 7.038077] logrotate[582]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed904gitlab # [ 7.041181] logrotate[582]: considering log /var/log/btmp905gitlab # [ 7.041955] logrotate[582]: Creating new state906gitlab # [ 7.042835] logrotate[582]: Now: 2026-10-21 22:08907gitlab # [ 7.045356] logrotate[582]: Last rotated at 2026-10-21 22:00908gitlab # [ 7.046240] logrotate[582]: log does not need rotating (log has already been rotated)909gitlab # [ 7.047343] logrotate[582]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed910gitlab # [ 7.049473] logrotate[582]: considering log /var/log/wtmp911gitlab # [ 7.050247] logrotate[582]: Creating new state912gitlab # [ 7.050958] logrotate[582]: Now: 2026-10-21 22:08913gitlab # [ 7.051708] logrotate[582]: Last rotated at 2026-10-21 22:00914gitlab: Guest shell says: b'Spawning backdoor root shell...\n'915gitlab # [ 7.052632] logrotate[582]: log does not need rotating (log has already been rotated)916gitlab # [ 7.055816] logrotate[582]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed917gitlab: connected to guest root shell918gitlab # [ 7.057524] logrotate[582]: switching euid from 0 to 165 and egid from 0 to 165 (pid 582)919gitlab: (connecting took 7.73 seconds)920gitlab # [ 7.057771] logrotate[582]: considering log /var/gitlab/state/log/*.log921gitlab: (finished: waiting for the VM to finish booting, in 7.73 seconds)922gitlab # [ 7.058438] logrotate[582]: log /var/gitlab/state/log/*.log does not exist -- skipping923gitlab # [ 7.058883] logrotate[582]: Creating new state924gitlab # [ 7.059336] logrotate[582]: switching euid from 165 to 0 and egid from 165 to 0 (pid 582)925gitlab # [ 7.059793] logrotate[582]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed926gitlab # [ 7.060237] logrotate[582]: switching euid from 0 to 60 and egid from 0 to 60 (pid 582)927gitlab # [ 7.060685] logrotate[582]: considering log /var/log/nginx/*.log928gitlab # [ 7.061144] logrotate[582]: log /var/log/nginx/*.log does not exist -- skipping929gitlab # [ 7.061578] logrotate[582]: Creating new state930gitlab # [ 7.062017] logrotate[582]: not running postrotate script, since no logs were rotated931gitlab # [ 7.062449] logrotate[582]: switching euid from 60 to 0 and egid from 60 to 0 (pid 582)932gitlab # [ 7.063117] systemd[1]: Finished Post-Boot Actions.933gitlab # [ 7.063731] systemd[1]: Finished Logrotate configuration check.934gitlab # [ 7.064288] systemd[1]: Finished Import lastlog data into lastlog2 database.935gitlab # [ 7.066925] nsncd[583]: Oct 21 22:08:56.498 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"936gitlab # [ 7.067410] systemd[1]: Started Name Service Cache Daemon (nsncd).937gitlab # [ 7.067845] systemd[1]: Reached target Host and Network Name Lookups.938gitlab # [ 7.068432] systemd[1]: Reached target User and Group Name Lookups.939gitlab # [ 7.071452] systemd[1]: Starting User Login Management...940gitlab # [ 7.103622] systemd[1]: Stopped target Host and Network Name Lookups.941gitlab # [ 7.103816] systemd[1]: Stopping Host and Network Name Lookups...942gitlab # [ 7.105809] systemd[1]: Stopped target User and Group Name Lookups.943gitlab # [ 7.106264] systemd[1]: Stopping User and Group Name Lookups...944gitlab # [ 7.106890] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...945gitlab # [ 7.109540] systemd[1]: nscd.service: Deactivated successfully.946gitlab # [ 7.110370] systemd[1]: Stopped Name Service Cache Daemon (nsncd).947gitlab # [ 7.111922] systemd[1]: nscd.service: Consumed 22ms CPU time over 97ms wall clock time, 7.1M memory peak, 5.5M read from disk.948gitlab # [ 7.114968] systemd[1]: Starting Name Service Cache Daemon (nsncd)...949gitlab # [ 7.115901] systemd-logind[626]: New seat seat0.950gitlab # [ 7.118847] systemd-logind[626]: Watching system buttons on /dev/input/event2 (Power Button)951gitlab # [ 7.119814] systemd-logind[626]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)952gitlab # [ 7.120352] systemd-logind[626]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)953gitlab # [ 7.121296] systemd[1]: Started User Login Management.954gitlab # [ 7.128339] systemd[1]: Starting linger-users.service...955gitlab # [ 7.137029] systemd[1]: Started Name Service Cache Daemon (nsncd).956gitlab # [ 7.138166] systemd[1]: Reached target Host and Network Name Lookups.957gitlab # [ 7.139389] systemd[1]: Reached target User and Group Name Lookups.958gitlab # [ 7.140864] nsncd[673]: Oct 21 22:08:56.569 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"959gitlab # [ 7.146888] systemd[1]: linger-users.service: Deactivated successfully.960gitlab # [ 7.147371] systemd[1]: Finished linger-users.service.961gitlab # [ 7.151445] systemd[1]: Finished resolvconf update.962gitlab # [ 7.151939] systemd[1]: Reached target Preparation for Network.963gitlab # [ 7.154448] systemd[1]: Starting DHCP Client...964gitlab # [ 7.155609] systemd[1]: Starting Address configuration of eth1...965gitlab # [ 7.157982] systemd[1]: Starting Extra networking commands....966gitlab # [ 7.189591] network-addresses-eth1-start[700]: adding address 192.168.1.1/24... done967gitlab # [ 7.195120] network-addresses-eth1-start[700]: adding address 2001:db8:1::1/64... done968gitlab # [ 7.199123] systemd[1]: Finished Address configuration of eth1.969gitlab # [ 7.226035] dhcpcd[709]: dhcpcd-10.3.2 starting970gitlab # [ 7.226447] systemd[1]: Finished Extra networking commands..971gitlab # [ 7.228061] systemd[1]: Reached target Network.972gitlab # [ 7.229836] dhcpcd[765]: dev: loaded udev973gitlab # [ 7.230565] systemd[1]: Starting gitlab-workhorse.service...974gitlab # [ 7.231471] systemd[1]: Starting Nginx Web Server...975gitlab # [ 7.234721] systemd[1]: Starting PostgreSQL Server...976gitlab # [ 7.387074] 8021q: 802.1Q VLAN Support v1.8977gitlab # [ 7.387758] 8021q: adding VLAN 0 to HW filter on device eth1978gitlab # [ 7.243701] systemd[1]: Starting Redis Server - redis-gitlab...979gitlab # [ 7.244700] systemd[1]: Starting Permit User Sessions...980gitlab # [ 7.248916] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.981gitlab # [ 7.258212] systemd[1]: Finished Permit User Sessions.982gitlab # [ 7.263452] systemd[1]: Started Getty on tty1.983gitlab # [ 7.264365] systemd[1]: Reached target Login Prompts.984gitlab # [ 7.473576] cfg80211: Loading compiled-in X.509 certificates for regulatory database985gitlab # [ 7.477054] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'986gitlab # [ 7.477819] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'987gitlab # [ 7.479431] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2988gitlab # [ 7.481664] cfg80211: failed to load regulatory.db989gitlab # [ 7.351717] nginx-pre-start[787]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok990gitlab # [ 7.352707] nginx-pre-start[787]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful991gitlab # [ 7.506103] 8021q: adding VLAN 0 to HW filter on device eth0992gitlab # [ 7.356931] systemd[1]: Started Nginx Web Server.993gitlab # [ 7.357454] dhcpcd[765]: eth0: waiting for carrier994gitlab # [ 7.358047] dhcpcd[765]: eth0: carrier acquired995gitlab # [ 7.362753] dhcpcd[765]: DUID 00:01:00:01:32:6b:f4:78:52:54:00:12:34:56996gitlab # [ 7.362892] dhcpcd[765]: eth0: IAID 00:12:34:56997gitlab # [ 7.363688] dhcpcd[765]: eth0: adding address fe80::5054:ff:fe12:3456998gitlab # [ 7.391908] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.999gitlab # [ 7.394311] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1000gitlab # [ 7.395686] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started1001gitlab # [ 7.397419] systemd[1]: Started Redis Server - redis-gitlab.1002gitlab # [ 7.398397] redis-server[790]: Configuration loaded1003gitlab # [ 7.399257] redis[790]: monotonic clock: POSIX clock_gettime1004gitlab # [ 7.400653] redis[790]: Running mode=standalone, port=0.1005gitlab # [ 7.401859] redis[790]: Server initialized1006gitlab # [ 7.402780] redis[790]: Ready to accept connections unix1007gitlab # [ 7.403921] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1008gitlab # [ 7.409563] postgresql-pre-start[798]: The files belonging to this database system will be owned by user "postgres".1009gitlab # [ 7.409940] postgresql-pre-start[798]: This user must also own the server process.1010gitlab # [ 7.414375] postgresql-pre-start[798]: The database cluster will be initialized with locale "en_US.UTF-8".1011gitlab # [ 7.414824] postgresql-pre-start[798]: The default database encoding has accordingly been set to "UTF8".1012gitlab # [ 7.415553] postgresql-pre-start[798]: The default text search configuration will be set to "english".1013gitlab # [ 7.416136] postgresql-pre-start[798]: Data page checksums are enabled.1014gitlab # [ 7.416735] postgresql-pre-start[798]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1015gitlab # [ 7.417175] postgresql-pre-start[798]: creating subdirectories ... ok1016gitlab # [ 7.417710] postgresql-pre-start[798]: selecting dynamic shared memory implementation ... posix1017gitlab # [ 7.445227] postgresql-pre-start[798]: selecting default "max_connections" ... 1001018gitlab # [ 7.482731] postgresql-pre-start[798]: selecting default "shared_buffers" ... 128MB1019gitlab # [ 7.719302] systemd[1]: Started gitlab-workhorse.service.1020gitlab # [ 7.881718] postgresql-pre-start[798]: selecting default time zone ... UTC1021gitlab # [ 7.883550] postgresql-pre-start[798]: creating configuration files ... ok1022gitlab # [ 7.911979] gitlab-workhorse[825]: time="2026-10-21T22:08:57Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41023gitlab # [ 7.912340] gitlab-workhorse[825]: time="2026-10-21T22:08:57Z" level=info msg="Using redis/go-redis"1024gitlab # [ 7.912906] gitlab-workhorse[825]: time="2026-10-21T22:08:57Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1025gitlab # [ 8.050393] postgresql-pre-start[798]: running bootstrap script ... ok1026gitlab # [ 8.465261] postgresql-pre-start[798]: performing post-bootstrap initialization ... ok1027gitlab # [ 8.678474] postgresql-pre-start[798]: syncing data to disk ... ok1028gitlab # [ 8.679354] postgresql-pre-start[798]: initdb: warning: enabling "trust" authentication for local connections1029gitlab # [ 8.679845] postgresql-pre-start[798]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1030gitlab # [ 8.680750] postgresql-pre-start[798]: Success. You can now start the database server using:1031gitlab # [ 8.681546] postgresql-pre-start[798]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1032gitlab # [ 8.754180] postgres[850]: [850] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1033gitlab # [ 8.754895] postgres[850]: [850] LOG: listening on IPv6 address "::1", port 54321034gitlab # [ 8.755830] postgres[850]: [850] LOG: listening on IPv4 address "127.0.0.1", port 54321035gitlab # [ 8.758601] postgres[850]: [850] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1036gitlab # [ 8.772182] postgres[859]: [859] LOG: database system was shut down at 2026-10-21 22:08:57 GMT1037gitlab # [ 8.780755] postgres[850]: [850] LOG: database system is ready to accept connections1038gitlab # [ 8.788828] systemd[1]: Started PostgreSQL Server.1039gitlab # [ 8.792331] systemd[1]: Starting PostgreSQL Setup Scripts...1040gitlab # [ 8.952099] postgresql-setup-start[870]: CREATE DATABASE1041gitlab # [ 8.972431] postgresql-setup-start[875]: CREATE ROLE1042gitlab # [ 8.980677] postgresql-setup-start[881]: ALTER DATABASE1043gitlab # [ 8.999897] postgresql-setup-start[886]: CREATE ROLE1044gitlab # [ 9.002038] systemd[1]: Finished PostgreSQL Setup Scripts.1045gitlab # [ 9.002566] systemd[1]: Reached target PostgreSQL.1046gitlab # [ 9.004100] systemd[1]: Starting gitlab-postgresql.service...1047gitlab # [ 9.090865] gitlab-postgresql-start[895]: CREATE DATABASE1048gitlab # [ 9.107266] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[880]: mkdir -p /var/gitlab/state/home/.ssh: OK1049gitlab # [ 9.110904] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[880]: chmod 700 /var/gitlab/state/home/.ssh: OK1050gitlab # [ 9.125500] gitlab-postgresql-start[900]: CREATE EXTENSION1051gitlab # [ 9.157662] systemd[1]: Finished gitlab-config.service.1052gitlab # [ 9.160942] systemd[1]: Started gitaly.service.1053gitlab # [ 9.161867] systemd[1]: Starting gitlab-db-config.service...1054gitlab # [ 9.206730] gitlab-postgresql-start[906]: CREATE EXTENSION1055gitlab # [ 9.208769] systemd[1]: Finished gitlab-postgresql.service.1056gitlab # [ 9.266130] dhcpcd[765]: eth0: soliciting a DHCP lease1057gitlab # [ 9.421886] NET: Registered PF_PACKET protocol family1058gitlab # [ 9.282617] dhcpcd[765]: eth0: offered 10.0.2.15 from 10.0.2.21059gitlab # [ 9.287201] dhcpcd[765]: eth0: probing address 10.0.2.15/241060gitlab # [ 9.423600] dhcpcd[765]: eth0: soliciting an IPv6 router1061gitlab # [ 9.425855] dhcpcd[765]: eth0: Router Advertisement from fe80::21062gitlab # [ 9.425978] dhcpcd[765]: eth0: adding address fec0::5054:ff:fe12:3456/641063gitlab # [ 9.426746] dhcpcd[765]: eth0: adding route to fec0::/641064gitlab # [ 9.427890] dhcpcd[765]: eth0: adding default route via fe80::21065gitlab # [ 9.709305] gitaly[915]: time="2026-10-21T22:08:59.141Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9151066gitlab # [ 9.712836] gitaly[915]: time="2026-10-21T22:08:59.141Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9151067gitlab # [ 9.714403] gitaly[915]: time="2026-10-21T22:08:59.141Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9151068gitlab # [ 9.717247] gitaly[915]: time="2026-10-21T22:08:59.141Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9151069gitlab # [ 9.719361] gitaly[915]: time="2026-10-21T22:08:59.142Z" level=info msg="Starting Gitaly" pid=915 version=1070gitlab # [ 9.899101] gitaly[915]: time="2026-10-21T22:08:59.331Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=188 pid=9151071gitlab # [ 9.901098] gitaly[915]: time="2026-10-21T22:08:59.332Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9151072gitlab # [ 9.902749] gitaly[915]: time="2026-10-21T22:08:59.333Z" level=info msg="finished initializing command factory" duration_ms=1 pid=9151073gitlab # [ 9.904539] gitaly[915]: time="2026-10-21T22:08:59.333Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-915/git-exec-3301836195.d/git pid=9151074gitlab # [ 9.906553] gitaly[915]: time="2026-10-21T22:08:59.338Z" level=info msg="finished detecting git version" duration_ms=4 pid=9151075gitlab # [ 9.908166] gitaly[915]: time="2026-10-21T22:08:59.338Z" level=info msg="using Git version" pid=915 version=2.53.g1076gitlab # [ 9.909554] gitaly[915]: time="2026-10-21T22:08:59.339Z" level=info msg="clearing disk cache object folder" pid=915 storage=default1077gitlab # [ 9.911189] gitaly[915]: time="2026-10-21T22:08:59.339Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache824938149 pid=915 storage=default1078gitlab # [ 9.913742] gitaly[915]: time="2026-10-21T22:08:59.339Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache824938149 pid=915 storage=default1079gitlab # [ 9.916572] gitaly[915]: time="2026-10-21T22:08:59.339Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9151080gitlab # [ 9.918816] gitaly[915]: time="2026-10-21T22:08:59.339Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9151081gitlab # [ 9.921478] gitaly[915]: time="2026-10-21T22:08:59.339Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache824938149 clear_duration_ms=0 pid=915 storage=default1082gitlab # [ 9.947302] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="counting repositories" pid=9151083gitlab # [ 9.947688] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="starting to count repositories" pid=915 storage_path=/var/gitlab/state/repositories1084gitlab # [ 9.948394] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9151085gitlab # [ 9.948991] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=915 storage_path=/var/gitlab/state/repositories1086gitlab # [ 9.949779] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9151087gitlab # [ 9.950570] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=915 schema=unix1088gitlab # [ 9.951177] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="finished tempdir cleaner walk" pid=915 storage=default time_ms=01089gitlab # [ 9.951930] gitaly[915]: time="2026-10-21T22:08:59.379Z" level=info msg="listening at address" address=/run/gitaly/gitaly-915/sock.d/intern pid=915 schema=unix1090gitlab # [ 9.961810] gitaly[915]: time="2026-10-21T22:08:59.394Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9151091gitlab # [ 9.963414] gitaly[915]: time="2026-10-21T22:08:59.394Z" level=info msg="Started Gitaly" duration_ms=251 pid=9151092gitlab # [ 9.964663] gitaly[915]: time="2026-10-21T22:08:59.394Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9151093gitlab # [ 9.966157] gitaly[915]: time="2026-10-21T22:08:59.394Z" level=info msg="maintenance: daily scheduled" pid=915 scheduled="2026-10-22 12:00:00 +0000 UTC"1094gitlab # [ 10.429496] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1095gitlab # [ 10.436614] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1096gitlab # [ 10.456077] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1097gitlab # [ 12.016680] gitaly[915]: time="2026-10-21T22:09:01.448Z" level=info msg="License database preloaded" duration_ms=2306 pid=9151098gitlab # [ 14.268568] dhcpcd[765]: eth0: leased 10.0.2.15 for 86400 seconds1099gitlab # [ 14.269322] dhcpcd[765]: eth0: adding route to 10.0.2.0/241100gitlab # [ 14.269974] dhcpcd[765]: eth0: adding default route via 10.0.2.21101gitlab # [ 14.364300] systemd[1]: Started DHCP Client.1102gitlab # [ 14.367831] systemd[1]: Reached target Network is Online.1103gitlab # [ 41.229349] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[922]: W, [2026-10-21T22:09:30.660922 #922] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1104gitlab # [ 43.160178] postgres[1318]: [1318] ERROR: relation "feature_gates" does not exist at character 5231105gitlab # [ 43.160557] postgres[1318]: [1318] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1106gitlab # [ 43.161958] postgres[1318]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1107gitlab # [ 43.164969] postgres[1318]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1108gitlab # [ 43.167378] postgres[1318]: attidentity AS identity,1109gitlab # [ 43.169320] postgres[1318]: attgenerated as attgenerated1110gitlab # [ 43.171276] postgres[1318]: FROM pg_attribute a1111gitlab # [ 43.173181] postgres[1318]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1112gitlab # [ 43.175163] postgres[1318]: LEFT JOIN pg_type t ON a.atttypid = t.oid1113gitlab # [ 43.177063] postgres[1318]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1114gitlab # [ 43.178923] postgres[1318]: WHERE a.attrelid = '"feature_gates"'::regclass1115gitlab # [ 43.181250] postgres[1318]: AND a.attnum > 0 AND NOT a.attisdropped1116gitlab # [ 43.183197] postgres[1318]: ORDER BY a.attnum1117gitlab # [ 43.185166] postgres[1318]:1118gitlab # [ 46.565380] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1119gitlab # [ 46.565825] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1120gitlab # [ 47.970482] gitlab-workhorse[825]: time="2026-10-21T22:09:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1121gitlab # [ 57.979650] gitlab-workhorse[825]: time="2026-10-21T22:09:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 65.530902] postgres[1417]: [1417] ERROR: relation "table_without_models" does not exist1123gitlab # [ 65.532189] postgres[1417]: [1417] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1124gitlab # [ 67.989689] gitlab-workhorse[825]: time="2026-10-21T22:09:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1125gitlab # [ 77.999823] gitlab-workhorse[825]: time="2026-10-21T22:10:07Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1126gitlab # [ 79.850471] systemd[1]: Finished gitlab-db-config.service.1127gitlab # [ 79.856075] systemd[1]: Started gitlab-sidekiq.service.1128gitlab # [ 79.858382] systemd[1]: Starting gitlab.service...1129gitlab # [ 80.202556] bundle[1647]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1130gitlab # [ 80.207414] bundle[1647]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1131gitlab # [ 80.211965] bundle[1647]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1132gitlab # [ 83.106525] sidekiq-cluster[1646]: {"severity":"INFO","time":"2026-10-21T22:10:12.516Z","message":"Starting cluster with 1 processes"}1133gitlab # [ 83.253743] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.661Z","pid":1647,"message":"* Enabling systemd notification integration"}1134gitlab # [ 83.257553] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"Puma starting in cluster mode..."}1135gitlab # [ 83.260900] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1136gitlab # [ 83.264589] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1137gitlab # [ 83.269158] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Min threads: 0"}1138gitlab # [ 83.272314] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Max threads: 4"}1139gitlab # [ 83.275410] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Environment: production"}1140gitlab # [ 83.278633] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Master PID: 1647"}1141gitlab # [ 83.281715] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Workers: 2"}1142gitlab # [ 83.284731] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1143gitlab # [ 83.288477] bundle[1647]: {"timestamp":"2026-10-21T22:10:12.685Z","pid":1647,"message":"* Preloading application"}1144gitlab # [ 88.000084] gitlab-workhorse[825]: time="2026-10-21T22:10:17Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145gitlab # [ 98.009622] gitlab-workhorse[825]: time="2026-10-21T22:10:27Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1146gitlab # [ 105.255795] bundle[1647]: W, [2026-10-21T22:10:34.687455 #1647] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1147gitlab # [ 107.628764] sidekiq-cluster[1677]: 2026-10-21T22:10:37.060Z pid=1677 tid=wf9 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1677, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434651136}1148gitlab # [ 107.830243] sidekiq-cluster[1677]: W, [2026-10-21T22:10:37.262386 #1677] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1149gitlab # [ 107.870140] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:37.302Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1150gitlab # [ 108.012236] gitlab-workhorse[825]: time="2026-10-21T22:10:37Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1151gitlab # [ 109.754579] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.186Z","message":"GitLab reliable fetch activated!"}1152gitlab # [ 109.758570] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.186Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1153gitlab # [ 109.781301] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.213Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1154gitlab # [ 109.786583] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.217Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1155gitlab # [ 109.793399] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.225Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1156gitlab # [ 109.798591] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.228Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1157gitlab # [ 109.799954] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.230Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1158gitlab # [ 109.811401] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.243Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1159gitlab # [ 109.814440] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.246Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1160gitlab # [ 109.824025] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.256Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1161gitlab # [ 109.831505] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.263Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1162gitlab # [ 109.834274] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.266Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1163gitlab # [ 109.844526] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.276Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1164gitlab # [ 109.852781] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.285Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1165gitlab # [ 109.859673] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.291Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1166gitlab # [ 109.866884] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.299Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1167gitlab # [ 109.874727] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.307Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1168gitlab # [ 109.882688] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.315Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1169gitlab # [ 109.891270] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.323Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1170gitlab # [ 109.899404] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.331Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1171gitlab # [ 109.907904] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.340Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1172gitlab # [ 109.916932] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.349Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1173gitlab # [ 109.926177] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.358Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1174gitlab # [ 109.934306] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.366Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1175gitlab # [ 109.942162] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.374Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1176gitlab # [ 109.950299] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.382Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1177gitlab # [ 109.958753] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.391Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1178gitlab # [ 109.967401] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.399Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1179gitlab # [ 109.976343] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.408Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1180gitlab # [ 109.984976] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.417Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1181gitlab # [ 109.993552] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.425Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1182gitlab # [ 110.002303] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.434Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1183gitlab # [ 110.010097] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.442Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1184gitlab # [ 110.019524] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.451Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1185gitlab # [ 110.027909] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.460Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1186gitlab # [ 110.036781] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.469Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1187gitlab # [ 110.045454] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.477Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1188gitlab # [ 110.053533] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.485Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1189gitlab # [ 110.061818] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.494Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1190gitlab # [ 110.070562] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.502Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1191gitlab # [ 110.078197] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.510Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1192gitlab # [ 110.085370] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.517Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1193gitlab # [ 110.093681] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.525Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1194gitlab # [ 110.100943] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.533Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1195gitlab # [ 110.109315] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.541Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1196gitlab # [ 110.117585] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.549Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1197gitlab # [ 110.126675] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.558Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1198gitlab # [ 110.134966] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.567Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1199gitlab # [ 110.142119] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.574Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1200gitlab # [ 110.150705] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.582Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1201gitlab # [ 110.158769] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.591Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1202gitlab # [ 110.166792] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.599Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1203gitlab # [ 110.174808] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.607Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1204gitlab # [ 110.182985] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.615Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1205gitlab # [ 110.206408] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.638Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1206gitlab # [ 110.218406] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.650Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1207gitlab # [ 110.228297] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.660Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1208gitlab # [ 110.238623] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.670Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1209gitlab # [ 110.247838] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.680Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1210gitlab # [ 110.258361] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.690Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1211gitlab # [ 110.266850] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.699Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1212gitlab # [ 110.275639] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.707Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1213gitlab # [ 110.284099] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.716Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1214gitlab # [ 110.291992] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.724Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1215gitlab # [ 110.300917] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.733Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1216gitlab # [ 110.348277] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.778Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1217gitlab # [ 110.356441] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.788Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1218gitlab # [ 110.366023] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.798Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1219gitlab # [ 110.369715] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.802Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1220gitlab # [ 110.380541] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.812Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1221gitlab # [ 110.389494] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.821Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1222gitlab # [ 110.399094] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.831Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1223gitlab # [ 110.407651] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.839Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1224gitlab # [ 110.417155] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.849Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1225gitlab # [ 110.425711] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.857Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1226gitlab # [ 110.434535] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.866Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1227gitlab # [ 110.443949] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.876Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1228gitlab # [ 110.452801] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.885Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1229gitlab # [ 110.461259] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.893Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1230gitlab # [ 110.469098] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.901Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1231gitlab # [ 110.477080] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.909Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1232gitlab # [ 110.484254] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.916Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1233gitlab # [ 110.492761] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.925Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1234gitlab # [ 110.500445] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.932Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1235gitlab # [ 110.510780] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.943Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1236gitlab # [ 110.518214] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.950Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1237gitlab # [ 110.527290] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.959Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1238gitlab # [ 110.534585] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.966Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1239gitlab # [ 110.543550] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.975Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1240gitlab # [ 110.550979] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.983Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1241gitlab # [ 110.559792] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.992Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1242gitlab # [ 110.567248] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:39.999Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1243gitlab # [ 110.575135] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.007Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1244gitlab # [ 110.581368] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.013Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1245gitlab # [ 110.585539] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.017Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1246gitlab # [ 110.590322] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.022Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1247gitlab # [ 110.594462] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.026Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1248gitlab # [ 110.598828] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.031Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1249gitlab # [ 110.600535] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.032Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1250gitlab # [ 110.602557] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.034Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1251gitlab # [ 110.612613] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.044Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1252gitlab # [ 110.615139] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.046Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1253gitlab # [ 110.617421] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.048Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1254gitlab # [ 110.619764] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.051Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1255gitlab # [ 110.621918] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.053Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1256gitlab # [ 110.624157] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.055Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1257gitlab # [ 110.626580] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.057Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1258gitlab # [ 110.629112] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.059Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1259gitlab # [ 110.631368] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.061Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1260gitlab # [ 110.633698] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.063Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1261gitlab # [ 110.635903] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:10:40.066Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1262gitlab # [ 118.013373] gitlab-workhorse[825]: time="2026-10-21T22:10:47Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1263gitlab # [ 128.015136] gitlab-workhorse[825]: time="2026-10-21T22:10:57Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1264gitlab # [ 131.075731] postgres[2126]: [2126] ERROR: relation "table_without_models" does not exist1265gitlab # [ 131.076418] postgres[2126]: [2126] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1266gitlab # [ 133.003405] postgres[2146]: [2146] ERROR: relation "table_without_models" does not exist1267gitlab # [ 133.004132] postgres[2146]: [2146] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1268gitlab # [ 133.517598] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:02.949Z","message":"Booted Rails 7.2.3.1 application in production environment"}1269gitlab # [ 133.524610] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:02.956Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1270gitlab # [ 133.526058] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:02.956Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1271gitlab # [ 133.527267] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:02.957Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1272gitlab # [ 133.528400] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:02.958Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1273gitlab # [ 134.859698] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:04.291Z","message":"Cleaning working queues"}1274gitlab # [ 134.864877] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:04.296Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"56975b3b8daafe573de2f600","created_at":"2026-10-21T22:10:08.925Z","trace_propagation_headers":{"sentry-trace":"351c26edd17d4835aeabc8a3b8c0c159-96f751458cf34aab","baggage":"sentry-trace_id=351c26edd17d4835aeabc8a3b8c0c159,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e923c97bc3ef0123e87ce93865e29c62","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-21T22:10:08.934Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-56975b3b8daafe573de2f600: start","job_status":"start","queue_duration_s":55.362661,"scheduling_latency_s":55.36272}1275gitlab # [ 135.036924] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:04.468Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"56975b3b8daafe573de2f600","created_at":"2026-10-21T22:10:08.925Z","trace_propagation_headers":{"sentry-trace":"351c26edd17d4835aeabc8a3b8c0c159-96f751458cf34aab","baggage":"sentry-trace_id=351c26edd17d4835aeabc8a3b8c0c159,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"e923c97bc3ef0123e87ce93865e29c62","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-21T22:10:08.934Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-56975b3b8daafe573de2f600: done: 0.17222 sec","job_status":"done","queue_duration_s":55.362661,"scheduling_latency_s":55.36272,"redis_calls":31,"redis_duration_s":0.007212,"redis_read_bytes":284,"redis_write_bytes":3897,"redis_feature_flag_calls":20,"redis_feature_flag_duration_s":0.004382,"redis_feature_flag_read_bytes":274,"redis_feature_flag_write_bytes":2650,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":16,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":16,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.082548759,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.17222,"completed_at":"2026-10-21T22:11:04.468Z","load_balancing_strategy":"primary","db_duration_s":0.057328,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1276gitlab # [ 136.452365] bundle[1647]: {"timestamp":"2026-10-21T22:11:05.884Z","pid":1647,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1277gitlab # [ 136.452533] bundle[1647]: {"timestamp":"2026-10-21T22:11:05.884Z","pid":1647,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1278gitlab # [ 136.453318] bundle[1647]: {"timestamp":"2026-10-21T22:11:05.884Z","pid":1647,"message":"! #\u003cThread:0x00007d35d0dce960 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1279gitlab # [ 136.454040] bundle[1647]: {"timestamp":"2026-10-21T22:11:05.884Z","pid":1647,"message":"! #\u003cThread:0x00007d35d0f96e78 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1280gitlab # [ 136.454794] bundle[1647]: {"timestamp":"2026-10-21T22:11:05.884Z","pid":1647,"message":"Use Ctrl-C to stop"}1281gitlab # [ 136.456285] bundle[1647]: {"timestamp":"2026-10-21T22:11:05.884Z","pid":1647,"message":"Sending status to systemd every 1.0 sec"}1282gitlab # [ 137.269644] bundle[1647]: {"timestamp":"2026-10-21T22:11:06.701Z","pid":1647,"message":"- Worker 0 (PID: 2209) booted in 0.78s, phase: 0"}1283gitlab # [ 137.275741] bundle[1647]: {"timestamp":"2026-10-21T22:11:06.708Z","pid":1647,"message":"- Worker 1 (PID: 2213) booted in 0.77s, phase: 0"}1284gitlab # [ 137.281250] systemd[1]: Started gitlab.service.1285gitlab # [ 137.281445] systemd[1]: Reached target Common target for all GitLab services..1286gitlab # [ 137.285096] systemd[1]: Starting setup-gitlab.service...1287gitlab # [ 137.306788] setup-gitlab-start[2246]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1288gitlab # [ 139.095992] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:11:08 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 17671289gitlab # [ 139.101145] setup-gitlab-start[2246]: + TOKEN=nixbot-test-token-of-20-chars1290gitlab # [ 139.103660] setup-gitlab-start[2246]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1291gitlab # [ 139.115691] runuser[2268]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1292gitlab # [ 139.513822] setup-gitlab-start[2269]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 139.518928] setup-gitlab-start[2269]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 139.523841] setup-gitlab-start[2269]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 140.088554] setup-gitlab-start[2269]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1296gitlab # [ 140.093574] setup-gitlab-start[2269]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1297gitlab # [ 140.098310] setup-gitlab-start[2269]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1298gitlab # [ 147.269926] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:16.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"dd0ff10d17c6da5eba833063","created_at":"2026-10-21T22:11:16.671Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.698Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-dd0ff10d17c6da5eba833063: start","job_status":"start","queue_duration_s":0.002263,"scheduling_latency_s":0.002305}1299gitlab # [ 147.433394] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:16.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"dd0ff10d17c6da5eba833063","created_at":"2026-10-21T22:11:16.671Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.698Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-dd0ff10d17c6da5eba833063: done: 0.163582 sec","job_status":"done","queue_duration_s":0.002263,"scheduling_latency_s":0.002305,"redis_calls":28,"redis_duration_s":0.06632400000000001,"redis_read_bytes":36,"redis_write_bytes":10593,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002389,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.001574,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8305,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.059691,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00267,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000506769,"duration_s":0.163582,"completed_at":"2026-10-21T22:11:16.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 147.481200] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:16.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5a736521836c82e5df9329bf","created_at":"2026-10-21T22:11:16.740Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a27bba708dd5dbdbea42eb4c72a44075","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.789Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5a736521836c82e5df9329bf: start","job_status":"start","queue_duration_s":0.123917,"scheduling_latency_s":0.123957}1301gitlab # [ 147.563243] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:16.994Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5a736521836c82e5df9329bf","created_at":"2026-10-21T22:11:16.740Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a27bba708dd5dbdbea42eb4c72a44075","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.789Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5a736521836c82e5df9329bf: done: 0.081729 sec","job_status":"done","queue_duration_s":0.123917,"scheduling_latency_s":0.123957,"redis_calls":12,"redis_duration_s":0.04452,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00309,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.039255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002175,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018875,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001748826,"duration_s":0.081729,"completed_at":"2026-10-21T22:11:16.994Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002384,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 147.620907] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:16.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fe21d856d87168a0b94a3683","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fe21d856d87168a0b94a3683: start","job_status":"start","queue_duration_s":0.186195,"scheduling_latency_s":0.186231}1303gitlab # [ 147.687032] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"fe21d856d87168a0b94a3683","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-fe21d856d87168a0b94a3683: done: 0.119144 sec","job_status":"done","queue_duration_s":0.186195,"scheduling_latency_s":0.186231,"redis_calls":16,"redis_duration_s":0.038332,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001171,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001839,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.035322,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000424635,"duration_s":0.119144,"completed_at":"2026-10-21T22:11:17.118Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 147.707383] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a4b1264da738cf8de38b8561","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a4b1264da738cf8de38b8561: start","job_status":"start","queue_duration_s":0.312212,"scheduling_latency_s":0.312243}1305gitlab # [ 147.767415] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a4b1264da738cf8de38b8561","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a4b1264da738cf8de38b8561: done: 0.073654 sec","job_status":"done","queue_duration_s":0.312212,"scheduling_latency_s":0.312243,"redis_calls":13,"redis_duration_s":0.010759,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003338,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007421,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073654,"completed_at":"2026-10-21T22:11:17.199Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 147.831149] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b01fee864a4a3be1d46932c8","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b01fee864a4a3be1d46932c8: start","job_status":"start","queue_duration_s":0.449486,"scheduling_latency_s":0.44951}1307gitlab # [ 147.878699] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b01fee864a4a3be1d46932c8","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b01fee864a4a3be1d46932c8: done: 0.047668 sec","job_status":"done","queue_duration_s":0.449486,"scheduling_latency_s":0.44951,"redis_calls":13,"redis_duration_s":0.008564,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00148,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047668,"completed_at":"2026-10-21T22:11:17.310Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 147.915891] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c1e2d223f3fb839ce22c017a","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c1e2d223f3fb839ce22c017a: start","job_status":"start","queue_duration_s":0.534412,"scheduling_latency_s":0.534435}1309gitlab # [ 147.973637] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c1e2d223f3fb839ce22c017a","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c1e2d223f3fb839ce22c017a: done: 0.05736 sec","job_status":"done","queue_duration_s":0.534412,"scheduling_latency_s":0.534435,"redis_calls":13,"redis_duration_s":0.010921,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00456,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05736,"completed_at":"2026-10-21T22:11:17.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 148.036845] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7c209b392713ea57285b3005","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7c209b392713ea57285b3005: start","job_status":"start","queue_duration_s":0.655361,"scheduling_latency_s":0.655382}1311gitlab # [ 148.086651] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"7c209b392713ea57285b3005","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-7c209b392713ea57285b3005: done: 0.048761 sec","job_status":"done","queue_duration_s":0.655361,"scheduling_latency_s":0.655382,"redis_calls":13,"redis_duration_s":0.009212000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048761,"completed_at":"2026-10-21T22:11:17.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 148.124148] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f9cb16e5c6a57a38ba16f13","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f9cb16e5c6a57a38ba16f13: start","job_status":"start","queue_duration_s":0.742496,"scheduling_latency_s":0.742534}1313gitlab # [ 148.179262] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1f9cb16e5c6a57a38ba16f13","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1f9cb16e5c6a57a38ba16f13: done: 0.055253 sec","job_status":"done","queue_duration_s":0.742496,"scheduling_latency_s":0.742534,"redis_calls":13,"redis_duration_s":0.010138,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.009035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.055253,"completed_at":"2026-10-21T22:11:17.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 148.216538] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b88bc9f848bdf91295866021","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b88bc9f848bdf91295866021: start","job_status":"start","queue_duration_s":0.834855,"scheduling_latency_s":0.834899}1315gitlab # [ 148.251614] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b88bc9f848bdf91295866021","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b88bc9f848bdf91295866021: done: 0.034929 sec","job_status":"done","queue_duration_s":0.834855,"scheduling_latency_s":0.834899,"redis_calls":13,"redis_duration_s":0.009969,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008317,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034929,"completed_at":"2026-10-21T22:11:17.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000957,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 148.289300] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a8e68da833cf4ce53d6ca5b4","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a8e68da833cf4ce53d6ca5b4: start","job_status":"start","queue_duration_s":0.906963,"scheduling_latency_s":0.907002}1317gitlab # [ 148.311904] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a8e68da833cf4ce53d6ca5b4","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a8e68da833cf4ce53d6ca5b4: done: 0.023251 sec","job_status":"done","queue_duration_s":0.906963,"scheduling_latency_s":0.907002,"redis_calls":13,"redis_duration_s":0.003451,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002354,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023251,"completed_at":"2026-10-21T22:11:17.743Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 148.350108] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b40969a4ca5ecd4681012f65","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b40969a4ca5ecd4681012f65: start","job_status":"start","queue_duration_s":0.968303,"scheduling_latency_s":0.968338}1319gitlab # [ 148.374622] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.806Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b40969a4ca5ecd4681012f65","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b40969a4ca5ecd4681012f65: done: 0.024526 sec","job_status":"done","queue_duration_s":0.968303,"scheduling_latency_s":0.968338,"redis_calls":13,"redis_duration_s":0.003562,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024526,"completed_at":"2026-10-21T22:11:17.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 148.411507] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b15e0fdcfd9023159b23d039","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b15e0fdcfd9023159b23d039: start","job_status":"start","queue_duration_s":1.029708,"scheduling_latency_s":1.029743}1321gitlab # [ 148.446156] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b15e0fdcfd9023159b23d039","created_at":"2026-10-21T22:11:16.768Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-832305413a594d92","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"01e88a5f244030ffcd6869aaf899ece2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.813Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b15e0fdcfd9023159b23d039: done: 0.033629 sec","job_status":"done","queue_duration_s":1.029708,"scheduling_latency_s":1.029743,"redis_calls":13,"redis_duration_s":0.00248,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033629,"completed_at":"2026-10-21T22:11:17.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 148.482779] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:17.914Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"24379aa679e50153c9fe75d4","created_at":"2026-10-21T22:11:16.807Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05166577d5d53eedefe5d016d19285b7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.815Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-24379aa679e50153c9fe75d4: start","job_status":"start","queue_duration_s":1.099632,"scheduling_latency_s":1.099671}1323gitlab # [ 148.765428] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"24379aa679e50153c9fe75d4","created_at":"2026-10-21T22:11:16.807Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"05166577d5d53eedefe5d016d19285b7","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.815Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-24379aa679e50153c9fe75d4: done: 0.28296 sec","job_status":"done","queue_duration_s":1.099632,"scheduling_latency_s":1.099671,"redis_calls":565,"redis_duration_s":0.09263,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000627,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.090727,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.213152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209523,"duration_s":0.28296,"completed_at":"2026-10-21T22:11:18.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 148.844876] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.276Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e14cf2abe26904fe336254b8","created_at":"2026-10-21T22:11:16.861Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa5948d708d11084f40f10d40937d6f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.912Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e14cf2abe26904fe336254b8: start","job_status":"start","queue_duration_s":1.364034,"scheduling_latency_s":1.364061}1325gitlab # [ 148.871798] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.304Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1326gitlab # [ 148.882508] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e14cf2abe26904fe336254b8","created_at":"2026-10-21T22:11:16.861Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa5948d708d11084f40f10d40937d6f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.912Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e14cf2abe26904fe336254b8: done: 0.038116 sec","job_status":"done","queue_duration_s":1.364034,"scheduling_latency_s":1.364061,"redis_calls":10,"redis_duration_s":0.002455,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000377,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001559,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000571022,"duration_s":0.038116,"completed_at":"2026-10-21T22:11:18.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000647,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 148.923164] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4fcb16e0681f96a6dedbeed1","created_at":"2026-10-21T22:11:16.920Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6c8aff8142e8f9e386904f054e24a22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-21T22:11:16.936Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4fcb16e0681f96a6dedbeed1: start","job_status":"start","queue_duration_s":1.418158,"scheduling_latency_s":1.418193}1328gitlab # [ 148.970116] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4fcb16e0681f96a6dedbeed1","created_at":"2026-10-21T22:11:16.920Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c6c8aff8142e8f9e386904f054e24a22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-10-21T22:11:16.936Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4fcb16e0681f96a6dedbeed1: done: 0.046922 sec","job_status":"done","queue_duration_s":1.418158,"scheduling_latency_s":1.418193,"redis_calls":10,"redis_duration_s":0.005242,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00089,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000522134,"duration_s":0.046922,"completed_at":"2026-10-21T22:11:18.401Z","load_balancing_strategy":"primary","db_duration_s":0.004947,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 149.008554] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.440Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"601be2ff272d79786a646e0b","created_at":"2026-10-21T22:11:16.983Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c34bb104e3c4602b9ed018c33c94d530","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.998Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-601be2ff272d79786a646e0b: start","job_status":"start","queue_duration_s":1.44175,"scheduling_latency_s":1.441787}1330gitlab # [ 149.042808] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"601be2ff272d79786a646e0b","created_at":"2026-10-21T22:11:16.983Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c34bb104e3c4602b9ed018c33c94d530","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:16.998Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-601be2ff272d79786a646e0b: done: 0.034118 sec","job_status":"done","queue_duration_s":1.44175,"scheduling_latency_s":1.441787,"redis_calls":12,"redis_duration_s":0.003632,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00127,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000772724,"exclusive_lock_hold_duration_s":0.004095772,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.034118,"completed_at":"2026-10-21T22:11:18.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00215,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 149.084070] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3b716df0e4996e796ed78a0b","created_at":"2026-10-21T22:11:17.039Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b67946cb5177a5d93ebf4e62a942da7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.070Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3b716df0e4996e796ed78a0b: start","job_status":"start","queue_duration_s":1.445098,"scheduling_latency_s":1.445136}1332gitlab # [ 149.158949] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3b716df0e4996e796ed78a0b","created_at":"2026-10-21T22:11:17.039Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b67946cb5177a5d93ebf4e62a942da7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.070Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3b716df0e4996e796ed78a0b: done: 0.074818 sec","job_status":"done","queue_duration_s":1.445098,"scheduling_latency_s":1.445136,"redis_calls":14,"redis_duration_s":0.003209,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000805,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001518,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00036066,"exclusive_lock_hold_duration_s":0.044314571000000004,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.074818,"completed_at":"2026-10-21T22:11:18.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 149.198494] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"15f25e4ed4a83e147b96bcc5","created_at":"2026-10-21T22:11:17.077Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e40d0ec063370fb838898df196f2839","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.095Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-15f25e4ed4a83e147b96bcc5: start","job_status":"start","queue_duration_s":1.535389,"scheduling_latency_s":1.535427}1334gitlab # [ 149.391387] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"15f25e4ed4a83e147b96bcc5","created_at":"2026-10-21T22:11:17.077Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e40d0ec063370fb838898df196f2839","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.095Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-15f25e4ed4a83e147b96bcc5: done: 0.192079 sec","job_status":"done","queue_duration_s":1.535389,"scheduling_latency_s":1.535427,"redis_calls":12,"redis_duration_s":0.0033689999999999996,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000611,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001607,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000762946,"exclusive_lock_hold_duration_s":0.157147627,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.192079,"completed_at":"2026-10-21T22:11:18.822Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050958,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 149.393776] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6c1399ecfa589bf7bd157427","created_at":"2026-10-21T22:11:17.097Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adaad5c86434b2873df949970bd4eb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-21T22:11:17.107Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6c1399ecfa589bf7bd157427: start","job_status":"start","queue_duration_s":1.716788,"scheduling_latency_s":1.716802}1336gitlab # [ 149.496789] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.928Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1337gitlab # [ 149.509616] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.941Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6c1399ecfa589bf7bd157427","created_at":"2026-10-21T22:11:17.097Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"adaad5c86434b2873df949970bd4eb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-10-21T22:11:17.107Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6c1399ecfa589bf7bd157427: done: 0.117167 sec","job_status":"done","queue_duration_s":1.716788,"scheduling_latency_s":1.716802,"redis_calls":10,"redis_duration_s":0.0034939999999999997,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000398,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000390273,"duration_s":0.117167,"completed_at":"2026-10-21T22:11:18.941Z","load_balancing_strategy":"primary","db_duration_s":0.000805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 149.548188] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:18.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a2c6c0285753f1e0af9098cf","created_at":"2026-10-21T22:11:17.120Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.129Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a2c6c0285753f1e0af9098cf: start","job_status":"start","queue_duration_s":1.850813,"scheduling_latency_s":1.85085}1339gitlab # [ 149.598154] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a2c6c0285753f1e0af9098cf","created_at":"2026-10-21T22:11:17.120Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.129Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a2c6c0285753f1e0af9098cf: done: 0.049912 sec","job_status":"done","queue_duration_s":1.850813,"scheduling_latency_s":1.85085,"redis_calls":19,"redis_duration_s":0.005716000000000001,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001293,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000492,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003029,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000851225,"duration_s":0.049912,"completed_at":"2026-10-21T22:11:19.029Z","load_balancing_strategy":"primary","db_duration_s":0.002683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 149.643843] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7a1202c98f62e88212bf5fc6","created_at":"2026-10-21T22:11:17.137Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7da3333b7c2cc7c62a9e25118b43bce2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.175Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7a1202c98f62e88212bf5fc6: start","job_status":"start","queue_duration_s":1.900041,"scheduling_latency_s":1.900078}1341gitlab # [ 149.673306] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.105Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7a1202c98f62e88212bf5fc6","created_at":"2026-10-21T22:11:17.137Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7da3333b7c2cc7c62a9e25118b43bce2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.175Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7a1202c98f62e88212bf5fc6: done: 0.029429 sec","job_status":"done","queue_duration_s":1.900041,"scheduling_latency_s":1.900078,"redis_calls":10,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000553,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001708,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000458717,"duration_s":0.029429,"completed_at":"2026-10-21T22:11:19.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000715,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 149.713531] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3523cd962b064aeabcf27cd3","created_at":"2026-10-21T22:11:17.187Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a7b2cb39c051073b54113230388c1ce","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.194Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3523cd962b064aeabcf27cd3: start","job_status":"start","queue_duration_s":1.950662,"scheduling_latency_s":1.950701}1343gitlab # [ 149.770284] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3523cd962b064aeabcf27cd3","created_at":"2026-10-21T22:11:17.187Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a7b2cb39c051073b54113230388c1ce","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.194Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3523cd962b064aeabcf27cd3: done: 0.056687 sec","job_status":"done","queue_duration_s":1.950662,"scheduling_latency_s":1.950701,"redis_calls":16,"redis_duration_s":0.005364,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002631,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00061,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000462908,"duration_s":0.056687,"completed_at":"2026-10-21T22:11:19.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 149.795424] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e046cb209ec2fb9f34123c0c","created_at":"2026-10-21T22:11:17.261Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f84c1a1ddcdc049d5c49067d3d2ef20e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.281Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e046cb209ec2fb9f34123c0c: start","job_status":"start","queue_duration_s":1.924029,"scheduling_latency_s":1.924065}1345gitlab # [ 149.839383] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.271Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e046cb209ec2fb9f34123c0c","created_at":"2026-10-21T22:11:17.261Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f84c1a1ddcdc049d5c49067d3d2ef20e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.281Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e046cb209ec2fb9f34123c0c: done: 0.065445 sec","job_status":"done","queue_duration_s":1.924029,"scheduling_latency_s":1.924065,"redis_calls":12,"redis_duration_s":0.003585,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000614,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001299,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069087,"exclusive_lock_hold_duration_s":0.03715556,"duration_s":0.065445,"completed_at":"2026-10-21T22:11:19.271Z","load_balancing_strategy":"primary","db_duration_s":0.032128,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 149.879090] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c87b3d54bccdf5dacb6baf1a","created_at":"2026-10-21T22:11:17.292Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25e1e1da77a58f84da9946820b522dae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.301Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c87b3d54bccdf5dacb6baf1a: start","job_status":"start","queue_duration_s":2.009066,"scheduling_latency_s":2.009105}1347gitlab # [ 149.907224] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.339Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1348gitlab # [ 149.921166] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c87b3d54bccdf5dacb6baf1a","created_at":"2026-10-21T22:11:17.292Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25e1e1da77a58f84da9946820b522dae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.301Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c87b3d54bccdf5dacb6baf1a: done: 0.042203 sec","job_status":"done","queue_duration_s":2.009066,"scheduling_latency_s":2.009105,"redis_calls":10,"redis_duration_s":0.005011,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000731,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000415416,"duration_s":0.042203,"completed_at":"2026-10-21T22:11:19.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 149.961575] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.393Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7460be938611fe30178f556f","created_at":"2026-10-21T22:11:17.307Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a655ce2753f6f17b0f9499ec834d498f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.364Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7460be938611fe30178f556f: start","job_status":"start","queue_duration_s":2.029154,"scheduling_latency_s":2.029194}1350gitlab # [ 150.017089] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.448Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7460be938611fe30178f556f","created_at":"2026-10-21T22:11:17.307Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a655ce2753f6f17b0f9499ec834d498f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.364Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7460be938611fe30178f556f: done: 0.055341 sec","job_status":"done","queue_duration_s":2.029154,"scheduling_latency_s":2.029194,"redis_calls":12,"redis_duration_s":0.0038209999999999997,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000801778,"exclusive_lock_hold_duration_s":0.018621919,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.055341,"completed_at":"2026-10-21T22:11:19.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015571,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 150.058084] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"20639c2d1a59c0c3c520d967","created_at":"2026-10-21T22:11:17.369Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ecc4488dbdb8eb83b53bff91a1e8e0d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.382Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-20639c2d1a59c0c3c520d967: start","job_status":"start","queue_duration_s":2.107322,"scheduling_latency_s":2.107361}1352gitlab # [ 150.109164] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"20639c2d1a59c0c3c520d967","created_at":"2026-10-21T22:11:17.369Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ecc4488dbdb8eb83b53bff91a1e8e0d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.382Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-20639c2d1a59c0c3c520d967: done: 0.050574 sec","job_status":"done","queue_duration_s":2.107322,"scheduling_latency_s":2.107361,"redis_calls":10,"redis_duration_s":0.003175,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000645,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000895365,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.050574,"completed_at":"2026-10-21T22:11:19.540Z","load_balancing_strategy":"primary","db_duration_s":0.016931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 150.157171] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.588Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f93b87cd285a7d2e5ca4112b","created_at":"2026-10-21T22:11:17.389Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04b3c0e90924217bef387db2cbd62562","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.400Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f93b87cd285a7d2e5ca4112b: start","job_status":"start","queue_duration_s":2.187812,"scheduling_latency_s":2.187836}1354gitlab # [ 150.166220] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.598Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1355gitlab # [ 150.171618] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f93b87cd285a7d2e5ca4112b","created_at":"2026-10-21T22:11:17.389Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"04b3c0e90924217bef387db2cbd62562","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.400Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f93b87cd285a7d2e5ca4112b: done: 0.015287 sec","job_status":"done","queue_duration_s":2.187812,"scheduling_latency_s":2.187836,"redis_calls":10,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000407314,"duration_s":0.015287,"completed_at":"2026-10-21T22:11:19.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 150.173466] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"32689154989b632f073ded88","created_at":"2026-10-21T22:11:17.465Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b05913e1d10dec90315691898bab218","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.490Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-32689154989b632f073ded88: start","job_status":"start","queue_duration_s":2.114216,"scheduling_latency_s":2.114231}1357gitlab # [ 150.213892] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"32689154989b632f073ded88","created_at":"2026-10-21T22:11:17.465Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b05913e1d10dec90315691898bab218","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.490Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-32689154989b632f073ded88: done: 0.01783 sec","job_status":"done","queue_duration_s":2.114216,"scheduling_latency_s":2.114231,"redis_calls":10,"redis_duration_s":0.001329,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000252,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000213715,"duration_s":0.01783,"completed_at":"2026-10-21T22:11:19.622Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 150.225195] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"694f1a4ed7325a7961ba0f57","created_at":"2026-10-21T22:11:17.496Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa33c8e49d6e72e68c6d628f8b29d747","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.515Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-694f1a4ed7325a7961ba0f57: start","job_status":"start","queue_duration_s":2.108527,"scheduling_latency_s":2.108541}1359gitlab # [ 150.275979] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.632Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1360gitlab # [ 150.276934] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"694f1a4ed7325a7961ba0f57","created_at":"2026-10-21T22:11:17.496Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fa33c8e49d6e72e68c6d628f8b29d747","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.515Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-694f1a4ed7325a7961ba0f57: done: 0.013521 sec","job_status":"done","queue_duration_s":2.108527,"scheduling_latency_s":2.108541,"redis_calls":10,"redis_duration_s":0.001341,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000227403,"duration_s":0.013521,"completed_at":"2026-10-21T22:11:19.637Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000403,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 150.281736] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.638Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"aec0748637f185f57bd3ca35","created_at":"2026-10-21T22:11:17.562Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.578Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-aec0748637f185f57bd3ca35: start","job_status":"start","queue_duration_s":2.059965,"scheduling_latency_s":2.059979}1362gitlab # [ 150.295497] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.708Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"aec0748637f185f57bd3ca35","created_at":"2026-10-21T22:11:17.562Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.578Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-aec0748637f185f57bd3ca35: done: 0.06985 sec","job_status":"done","queue_duration_s":2.059965,"scheduling_latency_s":2.059979,"redis_calls":71,"redis_duration_s":0.010157000000000001,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001349,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000607,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007773,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000428,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248914,"duration_s":0.06985,"completed_at":"2026-10-21T22:11:19.708Z","load_balancing_strategy":"primary","db_duration_s":0.004405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 150.355067] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.709Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ef3380571cf3d6dba9cdc84d","created_at":"2026-10-21T22:11:17.599Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"275fc8c5ac7bedab92e6fad58fba64aa","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.610Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ef3380571cf3d6dba9cdc84d: start","job_status":"start","queue_duration_s":2.098826,"scheduling_latency_s":2.098842}1364gitlab # [ 150.355840] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ef3380571cf3d6dba9cdc84d","created_at":"2026-10-21T22:11:17.599Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"275fc8c5ac7bedab92e6fad58fba64aa","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-10-21T22:11:17.610Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ef3380571cf3d6dba9cdc84d: done: 0.024037 sec","job_status":"done","queue_duration_s":2.098826,"scheduling_latency_s":2.098842,"redis_calls":13,"redis_duration_s":0.001844,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013956,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.008347151,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.024037,"completed_at":"2026-10-21T22:11:19.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004336,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1365gitlab # [ 150.406424] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d3ff84e0441b5b9f0a068dda","created_at":"2026-10-21T22:11:17.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"887e1a1fda4eab3902e2c2fbaa0afc24","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-21T22:11:17.667Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d3ff84e0441b5b9f0a068dda: start","job_status":"start","queue_duration_s":2.066921,"scheduling_latency_s":2.066936}1366gitlab # [ 150.407148] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.743Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1367gitlab # [ 150.407877] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"d3ff84e0441b5b9f0a068dda","created_at":"2026-10-21T22:11:17.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-98235be63a5546cb","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"887e1a1fda4eab3902e2c2fbaa0afc24","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-10-21T22:11:17.667Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-d3ff84e0441b5b9f0a068dda: done: 0.014288 sec","job_status":"done","queue_duration_s":2.066921,"scheduling_latency_s":2.066936,"redis_calls":10,"redis_duration_s":0.001402,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000864,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000233269,"duration_s":0.014288,"completed_at":"2026-10-21T22:11:19.748Z","load_balancing_strategy":"primary","db_duration_s":0.001368,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 150.453232] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.749Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56a34877e3f2fc814b66ee6f","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56a34877e3f2fc814b66ee6f: start","job_status":"start","queue_duration_s":0.729772,"scheduling_latency_s":0.729786}1369gitlab # [ 150.453895] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.760Z","message":"No existing merge request to be cleaned up."}1370gitlab # [ 150.454697] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.768Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"56a34877e3f2fc814b66ee6f","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-56a34877e3f2fc814b66ee6f: done: 0.018867 sec","job_status":"done","queue_duration_s":0.729772,"scheduling_latency_s":0.729786,"redis_calls":13,"redis_duration_s":0.001981,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000221816,"duration_s":0.018867,"completed_at":"2026-10-21T22:11:19.768Z","load_balancing_strategy":"primary","db_duration_s":0.002232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 150.512643] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.769Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8c9112a4cfb63695b1a5b349","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8c9112a4cfb63695b1a5b349: start","job_status":"start","queue_duration_s":0.749802,"scheduling_latency_s":0.749817}1372gitlab # [ 150.513498] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.776Z","message":"No existing merge request to be cleaned up."}1373gitlab # [ 150.514058] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.781Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8c9112a4cfb63695b1a5b349","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8c9112a4cfb63695b1a5b349: done: 0.011867 sec","job_status":"done","queue_duration_s":0.749802,"scheduling_latency_s":0.749817,"redis_calls":10,"redis_duration_s":0.0014069999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.011867,"completed_at":"2026-10-21T22:11:19.781Z","load_balancing_strategy":"primary","db_duration_s":0.00099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 150.571687] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.782Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6b4541cea0ff9e1f5f4076e9","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6b4541cea0ff9e1f5f4076e9: start","job_status":"start","queue_duration_s":0.762859,"scheduling_latency_s":0.762873}1375gitlab # [ 150.572615] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.791Z","message":"No existing merge request to be cleaned up."}1376gitlab # [ 150.573112] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.797Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6b4541cea0ff9e1f5f4076e9","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6b4541cea0ff9e1f5f4076e9: done: 0.015078 sec","job_status":"done","queue_duration_s":0.762859,"scheduling_latency_s":0.762873,"redis_calls":10,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015078,"completed_at":"2026-10-21T22:11:19.797Z","load_balancing_strategy":"primary","db_duration_s":0.005252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 150.618984] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.798Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"40331c869a1b36d4edc02192","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-40331c869a1b36d4edc02192: start","job_status":"start","queue_duration_s":0.778998,"scheduling_latency_s":0.779012}1378gitlab # [ 150.619625] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.847Z","message":"No existing merge request to be cleaned up."}1379gitlab # [ 150.620165] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.853Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"40331c869a1b36d4edc02192","created_at":"2026-10-21T22:11:19.002Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-e073f550a56e45f1","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8a333939482d681257f5a54eb8c933f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.019Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-40331c869a1b36d4edc02192: done: 0.054824 sec","job_status":"done","queue_duration_s":0.778998,"scheduling_latency_s":0.779012,"redis_calls":10,"redis_duration_s":0.0015149999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054824,"completed_at":"2026-10-21T22:11:19.853Z","load_balancing_strategy":"primary","db_duration_s":0.076816,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380gitlab # [ 150.671662] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41700d7184107d55f58cbd3d","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41700d7184107d55f58cbd3d: start","job_status":"start","queue_duration_s":0.15311,"scheduling_latency_s":0.153128}1381gitlab # [ 150.672562] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"41700d7184107d55f58cbd3d","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-41700d7184107d55f58cbd3d: done: 0.015709 sec","job_status":"done","queue_duration_s":0.15311,"scheduling_latency_s":0.153128,"redis_calls":16,"redis_duration_s":0.00209,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000268,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00119,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252266,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015709,"completed_at":"2026-10-21T22:11:19.870Z","load_balancing_strategy":"primary","db_duration_s":0.000277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 150.682022] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d372b0695eb919f50cea683c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d372b0695eb919f50cea683c: start","job_status":"start","queue_duration_s":0.169722,"scheduling_latency_s":0.169736}1383gitlab # [ 150.693647] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d372b0695eb919f50cea683c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d372b0695eb919f50cea683c: done: 0.010509 sec","job_status":"done","queue_duration_s":0.169722,"scheduling_latency_s":0.169736,"redis_calls":13,"redis_duration_s":0.001683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001139,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010509,"completed_at":"2026-10-21T22:11:19.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 150.739957] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de007295a0a0e9bdaf4ad591","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de007295a0a0e9bdaf4ad591: start","job_status":"start","queue_duration_s":0.181092,"scheduling_latency_s":0.181106}1385gitlab # [ 150.740712] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de007295a0a0e9bdaf4ad591","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de007295a0a0e9bdaf4ad591: done: 0.061275 sec","job_status":"done","queue_duration_s":0.181092,"scheduling_latency_s":0.181106,"redis_calls":13,"redis_duration_s":0.001916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.061275,"completed_at":"2026-10-21T22:11:19.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 150.786887] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0158cfd5d5c45e835def64df","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0158cfd5d5c45e835def64df: start","job_status":"start","queue_duration_s":0.24346,"scheduling_latency_s":0.243479}1387gitlab # [ 150.787734] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0158cfd5d5c45e835def64df","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0158cfd5d5c45e835def64df: done: 0.010592 sec","job_status":"done","queue_duration_s":0.24346,"scheduling_latency_s":0.243479,"redis_calls":13,"redis_duration_s":0.001645,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006697,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010592,"completed_at":"2026-10-21T22:11:19.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 150.832798] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa42a0c8c2996e55342f4316","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa42a0c8c2996e55342f4316: start","job_status":"start","queue_duration_s":0.255003,"scheduling_latency_s":0.255042}1389gitlab # [ 150.833842] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa42a0c8c2996e55342f4316","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa42a0c8c2996e55342f4316: done: 0.010221 sec","job_status":"done","queue_duration_s":0.255003,"scheduling_latency_s":0.255042,"redis_calls":13,"redis_duration_s":0.001681,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010221,"completed_at":"2026-10-21T22:11:19.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 150.873808] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0d2f16fa17c22f2882c170","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0d2f16fa17c22f2882c170: start","job_status":"start","queue_duration_s":0.266104,"scheduling_latency_s":0.266118}1391gitlab # [ 150.915064] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d0d2f16fa17c22f2882c170","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d0d2f16fa17c22f2882c170: done: 0.009798 sec","job_status":"done","queue_duration_s":0.266104,"scheduling_latency_s":0.266118,"redis_calls":13,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009798,"completed_at":"2026-10-21T22:11:19.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 150.916672] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"586090fb68344a7f14259e79","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-586090fb68344a7f14259e79: start","job_status":"start","queue_duration_s":0.276773,"scheduling_latency_s":0.276787}1393gitlab # [ 150.928418] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"586090fb68344a7f14259e79","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-586090fb68344a7f14259e79: done: 0.009761 sec","job_status":"done","queue_duration_s":0.276773,"scheduling_latency_s":0.276787,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009761,"completed_at":"2026-10-21T22:11:19.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 150.965565] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e239020ad0b287905922c640","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e239020ad0b287905922c640: start","job_status":"start","queue_duration_s":0.287391,"scheduling_latency_s":0.287404}1395gitlab # [ 150.977649] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:19.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e239020ad0b287905922c640","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e239020ad0b287905922c640: done: 0.009953 sec","job_status":"done","queue_duration_s":0.287391,"scheduling_latency_s":0.287404,"redis_calls":13,"redis_duration_s":0.001739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009953,"completed_at":"2026-10-21T22:11:19.998Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 151.021707] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6d885928ec84301d87e962f","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6d885928ec84301d87e962f: start","job_status":"start","queue_duration_s":0.301871,"scheduling_latency_s":0.301885}1397gitlab # [ 151.024263] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6d885928ec84301d87e962f","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6d885928ec84301d87e962f: done: 0.009924 sec","job_status":"done","queue_duration_s":0.301871,"scheduling_latency_s":0.301885,"redis_calls":13,"redis_duration_s":0.001642,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009924,"completed_at":"2026-10-21T22:11:20.013Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398gitlab # [ 151.064542] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f179bbbf5c977d5e2e0e09d","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f179bbbf5c977d5e2e0e09d: start","job_status":"start","queue_duration_s":0.312662,"scheduling_latency_s":0.312675}1399gitlab # [ 151.107856] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f179bbbf5c977d5e2e0e09d","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f179bbbf5c977d5e2e0e09d: done: 0.009756 sec","job_status":"done","queue_duration_s":0.312662,"scheduling_latency_s":0.312675,"redis_calls":13,"redis_duration_s":0.001598,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009756,"completed_at":"2026-10-21T22:11:20.023Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400gitlab # [ 151.108900] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81ae8bff6bec5ad78f6f24cb","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81ae8bff6bec5ad78f6f24cb: start","job_status":"start","queue_duration_s":0.323281,"scheduling_latency_s":0.323295}1401gitlab # [ 151.116791] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"81ae8bff6bec5ad78f6f24cb","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-81ae8bff6bec5ad78f6f24cb: done: 0.009676 sec","job_status":"done","queue_duration_s":0.323281,"scheduling_latency_s":0.323295,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009676,"completed_at":"2026-10-21T22:11:20.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 151.181637] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91b4f04a9a35340f5ade1b9c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91b4f04a9a35340f5ade1b9c: start","job_status":"start","queue_duration_s":0.33383,"scheduling_latency_s":0.333843}1403gitlab # [ 151.182580] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91b4f04a9a35340f5ade1b9c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91b4f04a9a35340f5ade1b9c: done: 0.010128 sec","job_status":"done","queue_duration_s":0.33383,"scheduling_latency_s":0.333843,"redis_calls":13,"redis_duration_s":0.001656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010128,"completed_at":"2026-10-21T22:11:20.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 151.199657] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1b39805f061bd333dcccc56","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1b39805f061bd333dcccc56: start","job_status":"start","queue_duration_s":0.344873,"scheduling_latency_s":0.344887}1405gitlab # [ 151.211132] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b1b39805f061bd333dcccc56","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b1b39805f061bd333dcccc56: done: 0.009663 sec","job_status":"done","queue_duration_s":0.344873,"scheduling_latency_s":0.344887,"redis_calls":13,"redis_duration_s":0.0015830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006185,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009663,"completed_at":"2026-10-21T22:11:20.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 151.267581] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76a1df0587b6f707c792818c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76a1df0587b6f707c792818c: start","job_status":"start","queue_duration_s":0.355417,"scheduling_latency_s":0.355432}1407gitlab # [ 151.268206] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76a1df0587b6f707c792818c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76a1df0587b6f707c792818c: done: 0.009568 sec","job_status":"done","queue_duration_s":0.355417,"scheduling_latency_s":0.355432,"redis_calls":13,"redis_duration_s":0.001973,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009568,"completed_at":"2026-10-21T22:11:20.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 151.293809] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a2a8ba816ce2959a5c5ac61","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a2a8ba816ce2959a5c5ac61: start","job_status":"start","queue_duration_s":0.365855,"scheduling_latency_s":0.365869}1409gitlab # [ 151.338736] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a2a8ba816ce2959a5c5ac61","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a2a8ba816ce2959a5c5ac61: done: 0.009564 sec","job_status":"done","queue_duration_s":0.365855,"scheduling_latency_s":0.365869,"redis_calls":13,"redis_duration_s":0.001732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009564,"completed_at":"2026-10-21T22:11:20.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 151.340036] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6ad4f202f09f9679ba01596","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6ad4f202f09f9679ba01596: start","job_status":"start","queue_duration_s":0.376599,"scheduling_latency_s":0.376612}1411gitlab # [ 151.351099] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6ad4f202f09f9679ba01596","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6ad4f202f09f9679ba01596: done: 0.010029 sec","job_status":"done","queue_duration_s":0.376599,"scheduling_latency_s":0.376612,"redis_calls":13,"redis_duration_s":0.001699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010029,"completed_at":"2026-10-21T22:11:20.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 151.387599] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aba5813bc810992fa2c2b63","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aba5813bc810992fa2c2b63: start","job_status":"start","queue_duration_s":0.387454,"scheduling_latency_s":0.387467}1413gitlab # [ 151.398958] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2aba5813bc810992fa2c2b63","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2aba5813bc810992fa2c2b63: done: 0.009896 sec","job_status":"done","queue_duration_s":0.387454,"scheduling_latency_s":0.387467,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009896,"completed_at":"2026-10-21T22:11:20.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 151.440575] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c03e61ac4020dc1dcf102df","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c03e61ac4020dc1dcf102df: start","job_status":"start","queue_duration_s":0.398276,"scheduling_latency_s":0.398289}1415gitlab # [ 151.445696] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c03e61ac4020dc1dcf102df","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c03e61ac4020dc1dcf102df: done: 0.009513 sec","job_status":"done","queue_duration_s":0.398276,"scheduling_latency_s":0.398289,"redis_calls":13,"redis_duration_s":0.0016879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009513,"completed_at":"2026-10-21T22:11:20.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 151.504081] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0c9cea41253080c7e6fd30e","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0c9cea41253080c7e6fd30e: start","job_status":"start","queue_duration_s":0.408943,"scheduling_latency_s":0.408957}1417gitlab # [ 151.504833] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0c9cea41253080c7e6fd30e","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0c9cea41253080c7e6fd30e: done: 0.009441 sec","job_status":"done","queue_duration_s":0.408943,"scheduling_latency_s":0.408957,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009441,"completed_at":"2026-10-21T22:11:20.119Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418gitlab # [ 151.553029] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"727d5ef8698e5fe009acadec","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-727d5ef8698e5fe009acadec: start","job_status":"start","queue_duration_s":0.419225,"scheduling_latency_s":0.419238}1419gitlab # [ 151.553776] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"727d5ef8698e5fe009acadec","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-727d5ef8698e5fe009acadec: done: 0.009649 sec","job_status":"done","queue_duration_s":0.419225,"scheduling_latency_s":0.419238,"redis_calls":13,"redis_duration_s":0.0020499999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009649,"completed_at":"2026-10-21T22:11:20.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 151.604577] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31af046cb646216ed292c55c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31af046cb646216ed292c55c: start","job_status":"start","queue_duration_s":0.429732,"scheduling_latency_s":0.429745}1421gitlab # [ 151.605273] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31af046cb646216ed292c55c","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31af046cb646216ed292c55c: done: 0.009529 sec","job_status":"done","queue_duration_s":0.429732,"scheduling_latency_s":0.429745,"redis_calls":13,"redis_duration_s":0.001944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009529,"completed_at":"2026-10-21T22:11:20.140Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422gitlab # [ 151.653826] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f2c0b8bf8b4ec9dec51a9b","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f2c0b8bf8b4ec9dec51a9b: start","job_status":"start","queue_duration_s":0.44018,"scheduling_latency_s":0.440194}1423gitlab # [ 151.654477] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f2c0b8bf8b4ec9dec51a9b","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f2c0b8bf8b4ec9dec51a9b: done: 0.009625 sec","job_status":"done","queue_duration_s":0.44018,"scheduling_latency_s":0.440194,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009625,"completed_at":"2026-10-21T22:11:20.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424gitlab # [ 151.668254] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"296c2520e382cbaaf7ce36c6","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-296c2520e382cbaaf7ce36c6: start","job_status":"start","queue_duration_s":0.451033,"scheduling_latency_s":0.451047}1425gitlab # [ 151.679727] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"296c2520e382cbaaf7ce36c6","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-296c2520e382cbaaf7ce36c6: done: 0.00966 sec","job_status":"done","queue_duration_s":0.451033,"scheduling_latency_s":0.451047,"redis_calls":13,"redis_duration_s":0.0015830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00966,"completed_at":"2026-10-21T22:11:20.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 151.719184] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c250272095da7d665d4857da","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c250272095da7d665d4857da: start","job_status":"start","queue_duration_s":0.461517,"scheduling_latency_s":0.46153}1427gitlab # [ 151.726147] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c250272095da7d665d4857da","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c250272095da7d665d4857da: done: 0.009729 sec","job_status":"done","queue_duration_s":0.461517,"scheduling_latency_s":0.46153,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009729,"completed_at":"2026-10-21T22:11:20.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 151.770311] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddf2b51b9cd2cae7b880ba5b","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddf2b51b9cd2cae7b880ba5b: start","job_status":"start","queue_duration_s":0.47208,"scheduling_latency_s":0.472094}1429gitlab # [ 151.772990] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ddf2b51b9cd2cae7b880ba5b","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ddf2b51b9cd2cae7b880ba5b: done: 0.009991 sec","job_status":"done","queue_duration_s":0.47208,"scheduling_latency_s":0.472094,"redis_calls":13,"redis_duration_s":0.001655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006483,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009991,"completed_at":"2026-10-21T22:11:20.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 151.827815] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cddf121e002e952680673f8","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cddf121e002e952680673f8: start","job_status":"start","queue_duration_s":0.482935,"scheduling_latency_s":0.482949}1431gitlab # [ 151.828793] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5cddf121e002e952680673f8","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5cddf121e002e952680673f8: done: 0.010889 sec","job_status":"done","queue_duration_s":0.482935,"scheduling_latency_s":0.482949,"redis_calls":13,"redis_duration_s":0.0019290000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001384,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010889,"completed_at":"2026-10-21T22:11:20.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 151.858645] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60b10180556f5c1443572393","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60b10180556f5c1443572393: start","job_status":"start","queue_duration_s":0.494819,"scheduling_latency_s":0.494832}1433gitlab # [ 151.870180] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60b10180556f5c1443572393","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60b10180556f5c1443572393: done: 0.009816 sec","job_status":"done","queue_duration_s":0.494819,"scheduling_latency_s":0.494832,"redis_calls":13,"redis_duration_s":0.001597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009816,"completed_at":"2026-10-21T22:11:20.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 151.922536] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4746f0e26cd84179383a928","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4746f0e26cd84179383a928: start","job_status":"start","queue_duration_s":0.505483,"scheduling_latency_s":0.505506}1435gitlab # [ 151.923123] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4746f0e26cd84179383a928","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4746f0e26cd84179383a928: done: 0.009962 sec","job_status":"done","queue_duration_s":0.505483,"scheduling_latency_s":0.505506,"redis_calls":13,"redis_duration_s":0.00171,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001145,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009962,"completed_at":"2026-10-21T22:11:20.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 151.974595] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb428eef7085f9e15d12310","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb428eef7085f9e15d12310: start","job_status":"start","queue_duration_s":0.516326,"scheduling_latency_s":0.516339}1437gitlab # [ 151.975528] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb428eef7085f9e15d12310","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb428eef7085f9e15d12310: done: 0.009765 sec","job_status":"done","queue_duration_s":0.516326,"scheduling_latency_s":0.516339,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009765,"completed_at":"2026-10-21T22:11:20.227Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 152.019148] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf4942e1a885b9ef132fe79a","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf4942e1a885b9ef132fe79a: start","job_status":"start","queue_duration_s":0.527065,"scheduling_latency_s":0.527079}1439gitlab # [ 152.019869] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.238Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf4942e1a885b9ef132fe79a","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf4942e1a885b9ef132fe79a: done: 0.009536 sec","job_status":"done","queue_duration_s":0.527065,"scheduling_latency_s":0.527079,"redis_calls":13,"redis_duration_s":0.001603,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009536,"completed_at":"2026-10-21T22:11:20.238Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 152.043853] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ce45bee1ec14b66737edc4b","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ce45bee1ec14b66737edc4b: start","job_status":"start","queue_duration_s":0.537817,"scheduling_latency_s":0.537829}1441gitlab # [ 152.055097] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ce45bee1ec14b66737edc4b","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ce45bee1ec14b66737edc4b: done: 0.009652 sec","job_status":"done","queue_duration_s":0.537817,"scheduling_latency_s":0.537829,"redis_calls":13,"redis_duration_s":0.0015930000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009652,"completed_at":"2026-10-21T22:11:20.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 152.099080] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eee8d6a5bcc86750a0be9990","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eee8d6a5bcc86750a0be9990: start","job_status":"start","queue_duration_s":0.548337,"scheduling_latency_s":0.54835}1443gitlab # [ 152.100859] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eee8d6a5bcc86750a0be9990","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eee8d6a5bcc86750a0be9990: done: 0.009554 sec","job_status":"done","queue_duration_s":0.548337,"scheduling_latency_s":0.54835,"redis_calls":13,"redis_duration_s":0.001613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009554,"completed_at":"2026-10-21T22:11:20.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 152.136671] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"472a792a54a8caad18bd0347","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-472a792a54a8caad18bd0347: start","job_status":"start","queue_duration_s":0.558787,"scheduling_latency_s":0.5588}1445gitlab # [ 152.178807] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"472a792a54a8caad18bd0347","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-472a792a54a8caad18bd0347: done: 0.009489 sec","job_status":"done","queue_duration_s":0.558787,"scheduling_latency_s":0.5588,"redis_calls":13,"redis_duration_s":0.001559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009489,"completed_at":"2026-10-21T22:11:20.269Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 152.183659] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9920199cb16b63582b0e79","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9920199cb16b63582b0e79: start","job_status":"start","queue_duration_s":0.569219,"scheduling_latency_s":0.569232}1447gitlab # [ 152.230723] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9920199cb16b63582b0e79","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9920199cb16b63582b0e79: done: 0.009988 sec","job_status":"done","queue_duration_s":0.569219,"scheduling_latency_s":0.569232,"redis_calls":13,"redis_duration_s":0.0016480000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009988,"completed_at":"2026-10-21T22:11:20.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 152.232219] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"964b84f5c2fbf7f40ca3c8a0","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-964b84f5c2fbf7f40ca3c8a0: start","job_status":"start","queue_duration_s":0.58007,"scheduling_latency_s":0.580083}1449gitlab # [ 152.243649] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"964b84f5c2fbf7f40ca3c8a0","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-964b84f5c2fbf7f40ca3c8a0: done: 0.009649 sec","job_status":"done","queue_duration_s":0.58007,"scheduling_latency_s":0.580083,"redis_calls":13,"redis_duration_s":0.002007,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001473,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009649,"completed_at":"2026-10-21T22:11:20.291Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 152.294198] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be04cdbdd1efb5123e8ec3ad","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be04cdbdd1efb5123e8ec3ad: start","job_status":"start","queue_duration_s":0.590756,"scheduling_latency_s":0.590769}1451gitlab # [ 152.294917] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be04cdbdd1efb5123e8ec3ad","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be04cdbdd1efb5123e8ec3ad: done: 0.009636 sec","job_status":"done","queue_duration_s":0.590756,"scheduling_latency_s":0.590769,"redis_calls":13,"redis_duration_s":0.001619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009636,"completed_at":"2026-10-21T22:11:20.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 152.335066] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a6cb971b7cf364a58a76b37","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a6cb971b7cf364a58a76b37: start","job_status":"start","queue_duration_s":0.601263,"scheduling_latency_s":0.601276}1453gitlab # [ 152.336642] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a6cb971b7cf364a58a76b37","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a6cb971b7cf364a58a76b37: done: 0.009947 sec","job_status":"done","queue_duration_s":0.601263,"scheduling_latency_s":0.601276,"redis_calls":13,"redis_duration_s":0.0015990000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009947,"completed_at":"2026-10-21T22:11:20.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 152.373623] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80f4742192bf26e5059a85f2","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80f4742192bf26e5059a85f2: start","job_status":"start","queue_duration_s":0.612186,"scheduling_latency_s":0.6122}1455gitlab # [ 152.384972] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80f4742192bf26e5059a85f2","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80f4742192bf26e5059a85f2: done: 0.009712 sec","job_status":"done","queue_duration_s":0.612186,"scheduling_latency_s":0.6122,"redis_calls":13,"redis_duration_s":0.00201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001466,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009712,"completed_at":"2026-10-21T22:11:20.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 152.435233] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"203aa1f77bf836fbfd60dc88","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-203aa1f77bf836fbfd60dc88: start","job_status":"start","queue_duration_s":0.622755,"scheduling_latency_s":0.622768}1457gitlab # [ 152.436077] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"203aa1f77bf836fbfd60dc88","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-203aa1f77bf836fbfd60dc88: done: 0.009518 sec","job_status":"done","queue_duration_s":0.622755,"scheduling_latency_s":0.622768,"redis_calls":13,"redis_duration_s":0.001715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000595,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009518,"completed_at":"2026-10-21T22:11:20.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 152.485523] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80dd27ac1b065922dce6f7f6","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80dd27ac1b065922dce6f7f6: start","job_status":"start","queue_duration_s":0.633122,"scheduling_latency_s":0.633135}1459gitlab # [ 152.486702] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80dd27ac1b065922dce6f7f6","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80dd27ac1b065922dce6f7f6: done: 0.009535 sec","job_status":"done","queue_duration_s":0.633122,"scheduling_latency_s":0.633135,"redis_calls":13,"redis_duration_s":0.001667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009535,"completed_at":"2026-10-21T22:11:20.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 152.532085] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e9867e18dacb06cfa7b34ff","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e9867e18dacb06cfa7b34ff: start","job_status":"start","queue_duration_s":0.64384,"scheduling_latency_s":0.643853}1461gitlab # [ 152.532674] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e9867e18dacb06cfa7b34ff","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e9867e18dacb06cfa7b34ff: done: 0.009408 sec","job_status":"done","queue_duration_s":0.64384,"scheduling_latency_s":0.643853,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009408,"completed_at":"2026-10-21T22:11:20.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 152.567684] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7569578b74d417b8fbf373a8","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7569578b74d417b8fbf373a8: start","job_status":"start","queue_duration_s":0.654087,"scheduling_latency_s":0.654101}1463gitlab # [ 152.578816] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7569578b74d417b8fbf373a8","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7569578b74d417b8fbf373a8: done: 0.009163 sec","job_status":"done","queue_duration_s":0.654087,"scheduling_latency_s":0.654101,"redis_calls":13,"redis_duration_s":0.0016330000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009163,"completed_at":"2026-10-21T22:11:20.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 152.619839] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f13c51220c8861bb917b99c5","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f13c51220c8861bb917b99c5: start","job_status":"start","queue_duration_s":0.664096,"scheduling_latency_s":0.664109}1465gitlab # [ 152.626186] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f13c51220c8861bb917b99c5","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f13c51220c8861bb917b99c5: done: 0.009237 sec","job_status":"done","queue_duration_s":0.664096,"scheduling_latency_s":0.664109,"redis_calls":13,"redis_duration_s":0.001658,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009237,"completed_at":"2026-10-21T22:11:20.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 152.667431] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.375Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0693fbb47e82f50c2cbb7dca","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0693fbb47e82f50c2cbb7dca: start","job_status":"start","queue_duration_s":0.674186,"scheduling_latency_s":0.6742}1467gitlab # [ 152.671382] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0693fbb47e82f50c2cbb7dca","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0693fbb47e82f50c2cbb7dca: done: 0.009151 sec","job_status":"done","queue_duration_s":0.674186,"scheduling_latency_s":0.6742,"redis_calls":13,"redis_duration_s":0.001605,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009151,"completed_at":"2026-10-21T22:11:20.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 152.719434] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4a423233d2aaf5d0b342593","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4a423233d2aaf5d0b342593: start","job_status":"start","queue_duration_s":0.6843,"scheduling_latency_s":0.684313}1469gitlab # [ 152.720471] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4a423233d2aaf5d0b342593","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4a423233d2aaf5d0b342593: done: 0.009491 sec","job_status":"done","queue_duration_s":0.6843,"scheduling_latency_s":0.684313,"redis_calls":13,"redis_duration_s":0.0018739999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001331,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009491,"completed_at":"2026-10-21T22:11:20.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 152.772666] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"689b988d083a2c95cab9c5b7","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-689b988d083a2c95cab9c5b7: start","job_status":"start","queue_duration_s":0.694657,"scheduling_latency_s":0.69467}1471gitlab # [ 152.773708] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"689b988d083a2c95cab9c5b7","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-689b988d083a2c95cab9c5b7: done: 0.029883 sec","job_status":"done","queue_duration_s":0.694657,"scheduling_latency_s":0.69467,"redis_calls":13,"redis_duration_s":0.001948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029883,"completed_at":"2026-10-21T22:11:20.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 152.805827] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90efc6643c2495809f8fdf54","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90efc6643c2495809f8fdf54: start","job_status":"start","queue_duration_s":0.725592,"scheduling_latency_s":0.72561}1473gitlab # [ 152.817627] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90efc6643c2495809f8fdf54","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90efc6643c2495809f8fdf54: done: 0.01088 sec","job_status":"done","queue_duration_s":0.725592,"scheduling_latency_s":0.72561,"redis_calls":13,"redis_duration_s":0.002584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000584,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01088,"completed_at":"2026-10-21T22:11:20.437Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 152.856985] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7239461101edcb1ccd467cf","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7239461101edcb1ccd467cf: start","job_status":"start","queue_duration_s":0.737331,"scheduling_latency_s":0.737345}1475gitlab # [ 152.863055] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7239461101edcb1ccd467cf","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7239461101edcb1ccd467cf: done: 0.009313 sec","job_status":"done","queue_duration_s":0.737331,"scheduling_latency_s":0.737345,"redis_calls":13,"redis_duration_s":0.0015710000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009313,"completed_at":"2026-10-21T22:11:20.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 152.899734] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90980fc4925a1286bbc4cdc","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90980fc4925a1286bbc4cdc: start","job_status":"start","queue_duration_s":0.747488,"scheduling_latency_s":0.747512}1477gitlab # [ 152.941750] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90980fc4925a1286bbc4cdc","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90980fc4925a1286bbc4cdc: done: 0.009225 sec","job_status":"done","queue_duration_s":0.747488,"scheduling_latency_s":0.747512,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009225,"completed_at":"2026-10-21T22:11:20.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 152.948035] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4996fc5f7092684785dc63f9","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4996fc5f7092684785dc63f9: start","job_status":"start","queue_duration_s":0.75765,"scheduling_latency_s":0.757664}1479gitlab # [ 152.959645] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:20.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4996fc5f7092684785dc63f9","created_at":"2026-10-21T22:11:19.653Z","trace_propagation_headers":{"sentry-trace":"0fa3ea1746c2485e97774a5a127dfc34-8f5c5a6593a4420d","baggage":"sentry-trace_id=0fa3ea1746c2485e97774a5a127dfc34,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"62c213915c991efc5c5bc048701ee000","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:11:19.701Z","job_size_bytes":2,"pid":1677,"sidekiq_tid":"majd","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4996fc5f7092684785dc63f9: done: 0.009225 sec","job_status":"done","queue_duration_s":0.75765,"scheduling_latency_s":0.757664,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001048,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009225,"completed_at":"2026-10-21T22:11:20.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 153.185170] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2766366764 wd_nsec: 27663656551481gitlab # [ 164.916965] setup-gitlab-start[2269]: W, [2026-10-21T22:11:34.348584 #2269] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1482gitlab # [ 186.165982] postgres[2457]: [2457] ERROR: relation "table_without_models" does not exist1483gitlab # [ 186.166913] postgres[2457]: [2457] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1484gitlab # [ 190.417773] runuser[2268]: pam_unix(runuser:session): session closed for user gitlab1485gitlab # [ 190.418762] setup-gitlab-start[2246]: + systemctl restart gitlab-sidekiq.service1486gitlab # [ 190.443802] systemd[1]: Stopping gitlab-sidekiq.service...1487gitlab # [ 190.444710] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:59.875Z","message":"Shutting down"}1488gitlab # [ 190.445459] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:59.876Z","message":"Scheduler exiting..."}1489gitlab # [ 190.448256] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:59.880Z","message":"Terminating quiet threads for default capsule"}1490gitlab # [ 190.448958] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:11:59.880Z","message":"Scheduler exiting..."}1491gitlab # [ 190.949714] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:12:00.381Z","message":"Pausing to allow jobs to finish..."}1492gitlab # [ 191.452876] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:12:00.884Z","message":"Bye!"}1493gitlab # [ 191.476508] sidekiq-cluster[1677]: {"severity":"INFO","time":"2026-10-21T22:12:00.908Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1677,"worker_id":"sidekiq_0","memwd_rss_bytes":938835968,"retry":0}1494gitlab # [ 193.139862] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1495gitlab # [ 193.140650] systemd[1]: Stopped gitlab-sidekiq.service.1496gitlab # [ 193.141820] systemd[1]: gitlab-sidekiq.service: Consumed 56.621s CPU time over 1min 53.284s wall clock time, 960.2M memory peak, 4.5M read from disk.1497gitlab # [ 193.144313] systemd[1]: Started gitlab-sidekiq.service.1498gitlab # [ 193.147935] setup-gitlab-start[2246]: + mkdir -p /var/lib/secrets1499gitlab # [ 193.150926] setup-gitlab-start[2246]: + echo nixbot-test-token-of-20-chars1500gitlab # [ 193.151804] setup-gitlab-start[2246]: + chmod 644 /var/lib/secrets/gitlab-token1501gitlab # [ 193.154558] setup-gitlab-start[2246]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1502gitlab # [ 193.497969] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:02 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 3111503gitlab # [ 194.237991] gitaly[915]: time="2026-10-21T22:12:03.669Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:13.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.668" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1504gitlab # [ 194.239283] gitaly[915]: time="2026-10-21T22:12:03.669Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:13.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.668" grpc.time_ms=0.421 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1505gitlab # [ 194.412168] gitaly[915]: time="2026-10-21T22:12:03.844Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:13.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.844" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1506gitlab # [ 194.428533] gitaly[915]: time="2026-10-21T22:12:03.844Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:13.183" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.844" grpc.time_ms=0.391 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1507gitlab # [ 194.495149] gitaly[915]: time="2026-10-21T22:12:03.927Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 diskcache=3deb82da-c967-4eef-8fce-2b774680b3f7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-21T22:12:13.218" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.879" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1508gitlab # [ 194.512324] gitaly[915]: time="2026-10-21T22:12:03.927Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1584 command.oublock=32 command.real_time_ms=19 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-21T22:12:13.218" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.879" grpc.time_ms=48.491 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1509gitlab # [ 194.512861] gitaly[915]: time="2026-10-21T22:12:03.941Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:13.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.941" pid=915 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1510gitlab # [ 194.513913] gitaly[915]: time="2026-10-21T22:12:03.941Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:13.280" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.941" grpc.time_ms=0.694 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1511gitlab # [ 194.576569] gitaly[915]: time="2026-10-21T22:12:04.008Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:12:13.048" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:03.999" grpc.time_ms=9.3 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1512gitlab # [ 194.683790] gitaly[915]: time="2026-10-21T22:12:04.116Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:14.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.115" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1513gitlab # [ 194.700329] gitaly[915]: time="2026-10-21T22:12:04.132Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:14.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.115" grpc.time_ms=0.657 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1514gitlab # [ 194.767857] gitaly[915]: time="2026-10-21T22:12:04.200Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 diskcache=d4d39843-dbf1-451b-8d2e-0c43b11958bd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-21T22:12:14.042" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.153" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1515gitlab # [ 194.768293] gitaly[915]: time="2026-10-21T22:12:04.200Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1583 command.oublock=32 command.real_time_ms=20 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-10-21T22:12:14.042" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.153" grpc.time_ms=46.865 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1516gitlab # [ 194.813899] gitaly[915]: time="2026-10-21T22:12:04.246Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:14.135" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.245" pid=915 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1517gitlab # [ 194.814558] gitaly[915]: time="2026-10-21T22:12:04.246Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:14.135" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.245" grpc.time_ms=0.663 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1518gitlab # [ 194.860658] gitaly[915]: time="2026-10-21T22:12:04.292Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:12:14.173" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.283" grpc.time_ms=8.869 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1519gitlab # [ 194.915745] gitaly[915]: time="2026-10-21T22:12:04.348Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:12:14.237" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.347" grpc.time_ms=0.226 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1520gitlab # [ 194.941776] gitaly[915]: time="2026-10-21T22:12:04.374Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-21T22:12:14.262" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:04.373" grpc.time_ms=0.346 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1521gitlab # [ 195.800460] gitaly[915]: time="2026-10-21T22:12:05.232Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8AYR56R5W659NG6CTV8J9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:12:15.110" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:05.220" grpc.time_ms=11.123 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1522gitlab # [ 196.312178] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:05 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 27931523gitlab # [ 196.317774] setup-gitlab-start[2512]: {"id":1,"message":null,"error":null}1524gitlab # [ 199.156204] sidekiq-cluster[2500]: {"severity":"INFO","time":"2026-10-21T22:12:08.556Z","message":"Starting cluster with 1 processes"}1525gitlab # [ 201.469279] gitaly[915]: time="2026-10-21T22:12:10.900Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B6CMF0XVCJ5317MQF4VN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:12:20.229" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:10.890" grpc.time_ms=9.911 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1526gitlab # [ 201.548537] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:10 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 2071527gitlab # [ 201.554434] setup-gitlab-start[2246]: + mkdir -p /tmp/test-flake1528gitlab # [ 201.557265] setup-gitlab-start[2246]: + cd /tmp/test-flake1529gitlab # [ 201.558804] setup-gitlab-start[2246]: + git init -b master1530gitlab # [ 201.582198] setup-gitlab-start[2590]: Initialized empty Git repository in /tmp/test-flake/.git/1531gitlab # [ 201.584342] setup-gitlab-start[2246]: + git config user.name test1532gitlab # [ 201.585911] setup-gitlab-start[2246]: + git config user.email test@example.com1533gitlab # [ 201.589152] setup-gitlab-start[2246]: + cat1534gitlab # [ 201.592158] setup-gitlab-start[2246]: + git add flake.nix1535gitlab # [ 201.596348] setup-gitlab-start[2246]: + git commit -m 'initial commit'1536gitlab # [ 201.620332] setup-gitlab-start[2595]: [master (root-commit) bc392c4] initial commit1537gitlab # [ 201.620888] setup-gitlab-start[2595]: 1 file changed, 10 insertions(+)1538gitlab # [ 201.621949] setup-gitlab-start[2595]: create mode 100644 flake.nix1539gitlab # [ 201.624928] setup-gitlab-start[2246]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1540gitlab # [ 201.633576] setup-gitlab-start[2246]: + git push -u origin master1541gitlab # [ 201.709412] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 441542gitlab # [ 202.305317] gitaly[915]: time="2026-10-21T22:12:11.737Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B6RAJJFVBTBXW6KH9ZG2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:11.727" grpc.time_ms=9.74 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1543gitlab # [ 202.327466] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:11 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 6121544gitlab # [ 202.711800] gitaly[915]: time="2026-10-21T22:12:12.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:12:22.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:12.132" grpc.time_ms=9.311 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1545gitlab # [ 202.780412] gitaly[915]: time="2026-10-21T22:12:12.212Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=330 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-21T22:12:42.002" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-21T22:12:12.203" grpc.time_ms=9.177 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1546gitlab # [ 202.807938] gitaly[915]: time="2026-10-21T22:12:12.240Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ duration_ms=206ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/allowed"1547gitlab # [ 202.848368] gitaly[915]: time="2026-10-21T22:12:12.280Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ duration_ms=35ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/pre_receive"1548gitlab # [ 202.853541] gitaly[915]: time="2026-10-21T22:12:12.285Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:12.032" grpc.time_ms=253.544 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1549gitlab # [ 202.908906] gitaly[915]: time="2026-10-21T22:12:12.340Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:12.338" grpc.time_ms=1.452 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1550gitlab # [ 202.967071] gitaly[915]: time="2026-10-21T22:12:12.399Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:12.397" grpc.time_ms=1.186 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1551gitlab # [ 203.021560] gitaly[915]: time="2026-10-21T22:12:12.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:12.452" grpc.time_ms=0.555 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1552gitlab # [ 203.324974] gitaly[915]: time="2026-10-21T22:12:12.756Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:12:22.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:12.747" grpc.time_ms=8.872 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1553gitlab # [ 203.360611] gitaly[915]: time="2026-10-21T22:12:12.792Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1566 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-21T22:12:22.028" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:12.769" grpc.time_ms=23.279 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1554gitlab # [ 203.391396] gitaly[915]: time="2026-10-21T22:12:12.823Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ duration_ms=313ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/post_receive"1555gitlab # [ 203.397541] gitaly[915]: time="2026-10-21T22:12:12.829Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:12.508" grpc.time_ms=320.775 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1556gitlab # [ 203.427968] gitaly[915]: time="2026-10-21T22:12:12.860Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ diskcache=79b3e1b0-5452-41e4-92fd-4d4b90cba889 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:11.959" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1557gitlab # [ 203.430084] gitlab-workhorse[825]: time="2026-10-21T22:12:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521558gitlab # [ 203.431868] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:12 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10861559gitlab # [ 203.450546] gitaly[915]: time="2026-10-21T22:12:12.882Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=243 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13982 command.oublock=32 command.real_time_ms=890 command.spawn_token_fork_ms=0 command.system_time_ms=138 command.user_time_ms=105 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:11.959" grpc.time_ms=900.99 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1560gitlab # [ 203.453938] setup-gitlab-start[2599]: To http://gitlab/root/test-flake.git1561gitlab # [ 203.455435] setup-gitlab-start[2599]: * [new branch] master -> master1562gitlab # [ 203.479473] setup-gitlab-start[2599]: branch 'master' set up to track 'origin/master'.1563gitlab # [ 203.485188] systemd[1]: Finished setup-gitlab.service.1564gitlab # [ 203.491545] systemd[1]: Starting nixbot CI service...1565gitlab: (finished: waiting for unit setup-gitlab.service, in 205.06 seconds)1566gitlab: waiting for unit nixbot.service1567gitlab # [ 205.265545] nixbot[2690]: {"ts": "2026-10-21T22:12:14.697Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1568gitlab # [ 205.300665] nixbot[2690]: {"ts": "2026-10-21T22:12:14.732Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1569gitlab # [ 205.323539] nixbot[2690]: {"ts": "2026-10-21T22:12:14.755Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1570gitlab # [ 205.329190] nixbot[2690]: {"ts": "2026-10-21T22:12:14.761Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1571gitlab # [ 205.333274] nixbot[2690]: {"ts": "2026-10-21T22:12:14.765Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1572gitlab # [ 205.340578] nixbot[2690]: {"ts": "2026-10-21T22:12:14.772Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1573gitlab # [ 205.344904] nixbot[2690]: {"ts": "2026-10-21T22:12:14.776Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1574gitlab # [ 205.351371] nixbot[2690]: {"ts": "2026-10-21T22:12:14.783Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1575gitlab # [ 205.362788] nixbot[2690]: {"ts": "2026-10-21T22:12:14.795Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1576gitlab # [ 205.368833] nixbot[2690]: {"ts": "2026-10-21T22:12:14.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1577gitlab # [ 205.374904] nixbot[2690]: {"ts": "2026-10-21T22:12:14.807Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1578gitlab # [ 205.382066] nixbot[2690]: {"ts": "2026-10-21T22:12:14.814Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1579gitlab # [ 205.389474] nixbot[2690]: {"ts": "2026-10-21T22:12:14.821Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1580gitlab # [ 205.391918] nixbot[2690]: {"ts": "2026-10-21T22:12:14.824Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1581gitlab # [ 205.402268] nixbot[2690]: {"ts": "2026-10-21T22:12:14.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1582gitlab # [ 205.404691] nixbot[2690]: {"ts": "2026-10-21T22:12:14.836Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1583gitlab # [ 205.412155] nixbot[2690]: {"ts": "2026-10-21T22:12:14.844Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1584gitlab # [ 205.414666] nixbot[2690]: {"ts": "2026-10-21T22:12:14.846Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1585gitlab # [ 205.425564] nixbot[2690]: {"ts": "2026-10-21T22:12:14.857Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1586gitlab # [ 205.427986] nixbot[2690]: {"ts": "2026-10-21T22:12:14.860Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1587gitlab # [ 205.430793] nixbot[2690]: {"ts": "2026-10-21T22:12:14.863Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1588gitlab # [ 205.437237] nixbot[2690]: {"ts": "2026-10-21T22:12:14.869Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1589gitlab # [ 205.443638] nixbot[2690]: {"ts": "2026-10-21T22:12:14.875Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1590gitlab # [ 205.450537] nixbot[2690]: {"ts": "2026-10-21T22:12:14.882Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1591gitlab # [ 205.452814] nixbot[2690]: {"ts": "2026-10-21T22:12:14.885Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1592gitlab # [ 205.457402] nixbot[2690]: {"ts": "2026-10-21T22:12:14.889Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1593gitlab # [ 205.461481] nixbot[2690]: {"ts": "2026-10-21T22:12:14.893Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1594gitlab # [ 205.463455] nixbot[2690]: {"ts": "2026-10-21T22:12:14.895Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1595gitlab # [ 205.465638] nixbot[2690]: {"ts": "2026-10-21T22:12:14.897Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1596gitlab # [ 205.480265] nixbot[2690]: {"ts": "2026-10-21T22:12:14.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1597gitlab # [ 205.488946] nixbot[2690]: {"ts": "2026-10-21T22:12:14.921Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1598gitlab # [ 205.494681] nixbot[2690]: {"ts": "2026-10-21T22:12:14.926Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1599gitlab # [ 205.500737] nixbot[2690]: {"ts": "2026-10-21T22:12:14.933Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1600gitlab # [ 205.510534] nixbot[2690]: {"ts": "2026-10-21T22:12:14.942Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1601gitlab # [ 205.516654] nixbot[2690]: {"ts": "2026-10-21T22:12:14.948Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1602gitlab # [ 205.527807] nixbot[2690]: {"ts": "2026-10-21T22:12:14.959Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1603gitlab # [ 205.535604] nixbot[2690]: {"ts": "2026-10-21T22:12:14.967Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1604gitlab # [ 205.545130] nixbot[2690]: {"ts": "2026-10-21T22:12:14.977Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 37, "migration": "effect_when_changed"}1605gitlab # [ 206.127644] nixbot[2690]: {"ts": "2026-10-21T22:12:15.559Z", "level": "info", "logger": "uvicorn.error", "msg": "Started server process [2690]", "color_message": "Started server process [\u001b[36m%d\u001b[0m]"}1606gitlab # [ 206.128751] nixbot[2690]: {"ts": "2026-10-21T22:12:15.560Z", "level": "info", "logger": "uvicorn.error", "msg": "Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)"}1607gitlab # [ 206.169721] nixbot[2690]: {"ts": "2026-10-21T22:12:15.600Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:34766 - \"GET /health HTTP/1.1\" 200"}1608gitlab # [ 206.178451] systemd[1]: Started nixbot CI service.1609gitlab # [ 206.180617] systemd[1]: Reached target Multi-User System.1610gitlab # [ 206.182287] systemd[1]: Startup finished in 1.154s (kernel) + 3.487s (initrd) + 3min 21.540s (userspace) = 3min 26.182s.1611gitlab: (finished: waiting for unit nixbot.service, in 2.09 seconds)1612gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1613gitlab # [ 206.514749] nixbot[2690]: {"ts": "2026-10-21T22:12:15.946Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:34768 - \"GET /health HTTP/1.1\" 200"}1614gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.03 seconds)1615subtest: project discovered and webhook registered1616gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1617gitlab # [ 206.626101] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 751618gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.11 seconds)1619gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1620gitlab # [ 207.728938] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 661621gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.10 seconds)1622gitlab # [ 208.506965] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:17 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 23391623gitlab # [ 208.531891] nixbot[2690]: {"ts": "2026-10-21T22:12:17.963Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1624gitlab # [ 208.640268] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 971625gitlab # [ 208.643529] nixbot[2690]: {"ts": "2026-10-21T22:12:18.075Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1626gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1627gitlab # [ 208.791181] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 917 "" "python-httpx/0.28.1" 1431628gitlab # [ 208.887160] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "curl/8.21.0" 1271629gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1630(finished: subtest: project discovered and webhook registered, in 2.38 seconds)1631subtest: push delivers the webhook1632gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1633gitlab # [ 208.994567] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1921634gitlab # [ 209.073454] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 880 "" "python-httpx/0.28.1" 671635gitlab # [ 209.148540] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 917 "" "python-httpx/0.28.1" 671636gitlab # [ 209.214753] gitaly[915]: time="2026-10-21T22:12:18.646Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BE0S7FS2WMYS41AP1MM7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-10-21T22:12:48.432" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:18.633" grpc.time_ms=12.623 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1637gitlab # [ 209.247634] gitaly[915]: time="2026-10-21T22:12:18.679Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BE0S7FS2WMYS41AP1MM7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:12:48.478" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:18.678" grpc.time_ms=0.765 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1638gitlab # [ 209.272807] gitaly[915]: time="2026-10-21T22:12:18.705Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BE0S7FS2WMYS41AP1MM7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-10-21T22:12:28.035" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:18.696" grpc.time_ms=8.599 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1639gitlab # [ 209.316674] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1621640gitlab # [ 209.406466] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 841641gitlab # [ 209.413269] nixbot[2690]: {"ts": "2026-10-21T22:12:18.845Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1642gitlab # [ 209.533652] gitaly[915]: time="2026-10-21T22:12:18.965Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BEB28XBTWE9AM4PQ3WPJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:18.954" grpc.time_ms=10.567 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1643gitlab # [ 209.551159] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:18 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 681644gitlab # [ 209.647621] gitaly[915]: time="2026-10-21T22:12:19.079Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEDBA8RE7XG09BN6KVD1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.070" pid=915 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1645gitlab # [ 209.648291] gitaly[915]: time="2026-10-21T22:12:19.080Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEDBA8RE7XG09BN6KVD1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.070" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1646gitlab # [ 209.649607] gitaly[915]: time="2026-10-21T22:12:19.081Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=644 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEDBA8RE7XG09BN6KVD1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.070" grpc.time_ms=10.595 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1647gitlab # [ 209.650968] gitlab-workhorse[825]: time="2026-10-21T22:12:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131648gitlab # [ 209.652141] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 941649gitlab # [ 209.791101] gitaly[915]: time="2026-10-21T22:12:19.223Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEHW0V0RAG9MW36QG71P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.204" pid=915 remote_ip="2001:db8:1::1" request_sha=b2f8ddce402bafa8592a5545821f27f154135b5c response_bytes=223 span.kind=server system=grpc1650gitlab # [ 209.791546] gitaly[915]: time="2026-10-21T22:12:19.223Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEHW0V0RAG9MW36QG71P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.204" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1651gitlab # [ 209.793078] gitaly[915]: time="2026-10-21T22:12:19.223Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1201 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEHW0V0RAG9MW36QG71P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.204" grpc.time_ms=19.408 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1652gitlab # [ 209.847387] gitlab-workhorse[825]: time="2026-10-21T22:12:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231653gitlab # [ 209.848162] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1461654gitlab # [ 209.964118] gitaly[915]: time="2026-10-21T22:12:19.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BEQZEN3RGRJZMP08RDX6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.387" grpc.time_ms=9.25 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1655gitlab # [ 209.989740] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 941656gitlab # [ 210.047381] gitaly[915]: time="2026-10-21T22:12:19.479Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEV3ESFWGD922EQXY4FF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.468" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1657gitlab # [ 210.047749] gitaly[915]: time="2026-10-21T22:12:19.479Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEV3ESFWGD922EQXY4FF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.468" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1658gitlab # [ 210.049286] gitaly[915]: time="2026-10-21T22:12:19.479Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BEV3ESFWGD922EQXY4FF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.468" grpc.time_ms=11.169 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1659gitlab # [ 210.106129] gitlab-workhorse[825]: time="2026-10-21T22:12:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671660gitlab # [ 210.106770] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1111661gitlab # [ 210.212333] gitaly[915]: time="2026-10-21T22:12:19.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BEZQGQ7DCAPW3KNBYYHV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.623" grpc.time_ms=20.229 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1662gitlab # [ 210.214580] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 711663gitlab # [ 210.301304] gitaly[915]: time="2026-10-21T22:12:19.732Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF22WTY8ZY5707RMSG1F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.713" pid=915 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1664gitlab # [ 210.302971] gitaly[915]: time="2026-10-21T22:12:19.732Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF22WTY8ZY5707RMSG1F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.713" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1665gitlab # [ 210.303825] gitlab-workhorse[825]: time="2026-10-21T22:12:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091666gitlab # [ 210.304972] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 821667gitlab # [ 210.305980] gitaly[915]: time="2026-10-21T22:12:19.732Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF22WTY8ZY5707RMSG1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:19.713" grpc.time_ms=19.408 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1668gitlab # [ 210.451097] gitaly[915]: time="2026-10-21T22:12:19.883Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:12:49.681" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:19.882" grpc.time_ms=0.566 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 210.499962] gitaly[915]: time="2026-10-21T22:12:19.932Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-21T22:12:49.723" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:19.923" grpc.time_ms=8.686 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670gitlab # [ 210.521771] gitaly[915]: time="2026-10-21T22:12:19.954Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:12:29.285" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:19.946" grpc.time_ms=7.993 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671gitlab # [ 210.537412] gitaly[915]: time="2026-10-21T22:12:19.969Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:12:29.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:19.962" grpc.time_ms=7.511 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 210.594068] gitaly[915]: time="2026-10-21T22:12:20.026Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-21T22:12:30.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:20.025" grpc.time_ms=0.252 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673gitlab # [ 210.618934] gitaly[915]: time="2026-10-21T22:12:20.051Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-21T22:12:30.023" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:20.044" grpc.time_ms=6.448 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1674gitlab # [ 210.662197] gitaly[915]: time="2026-10-21T22:12:20.094Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:20.093" grpc.time_ms=0.408 pid=915 span.kind=server system=grpc1675gitlab # [ 210.700126] gitaly[915]: time="2026-10-21T22:12:20.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:12:20.132" grpc.time_ms=0.357 pid=915 span.kind=server system=grpc1676gitlab # [ 210.717956] gitaly[915]: time="2026-10-21T22:12:20.150Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 diskcache=34f7f092-8f48-4626-9178-930de80a6aab grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-21T22:12:30.035" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:20.055" pid=915 ref=refs/keep-around/bc392c49b7b583b9be53b29d569a4dee5a7bd21b remote_ip="2001:db8:1::1" revision=bc392c49b7b583b9be53b29d569a4dee5a7bd21b span.kind=server system=grpc username=root1677gitlab # [ 210.729768] gitaly[915]: time="2026-10-21T22:12:20.162Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=73 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5449 command.oublock=8 command.real_time_ms=87 command.spawn_token_fork_ms=2 command.system_time_ms=44 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-21T22:12:30.035" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:12:20.055" grpc.time_ms=94.59 pid=915 ref=refs/keep-around/bc392c49b7b583b9be53b29d569a4dee5a7bd21b remote_ip="2001:db8:1::1" revision=bc392c49b7b583b9be53b29d569a4dee5a7bd21b span.kind=server system=grpc username=root1678gitlab # [ 210.745906] gitaly[915]: time="2026-10-21T22:12:20.178Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:12:50.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:20.177" grpc.time_ms=0.44 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679gitlab # [ 210.929814] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 5441680gitlab # [ 210.944872] nixbot[2690]: {"ts": "2026-10-21T22:12:20.376Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-bc392c49b7b5-0"}1681gitlab # [ 211.133163] nixbot[2690]: {"ts": "2026-10-21T22:12:20.565Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-bc392c49b7b5-0", "argv0": "bwrap"}1682gitlab # [ 211.236902] systemd[1]: Started Nix Daemon.1683gitlab # [ 211.281042] nix-daemon[2865]: accepted connection from pid 2860, user nixbot1684gitlab # [ 216.017175] nix-daemon[2865]: accepted connection from pid 2908, user nixbot1685gitlab # [ 216.037719] nix-daemon[2865]: accepted connection from pid 2860, user nixbot1686gitlab # [ 221.126745] nix-daemon[2865]: accepted connection from pid 2860, user nixbot1687gitlab # [ 221.201552] nix-daemon[2865]: accepted connection from pid 2960, user nixbot1688gitlab # [ 221.234591] gitaly[915]: time="2026-10-21T22:12:30.666Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BSRV1YYGHZ4X4XRQYV21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:00.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:30.663" grpc.time_ms=3.16 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689gitlab # [ 221.320596] gitaly[915]: time="2026-10-21T22:12:30.752Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BSRV1YYGHZ4X4XRQYV21 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:12:40.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:30.744" grpc.time_ms=8.296 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1690gitlab # [ 221.430977] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 676 "" "python-httpx/0.28.1" 2431691gitlab # [ 221.474088] gitaly[915]: time="2026-10-21T22:12:30.906Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BT0KFV12C5GRBNB27P2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:00.304" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:30.905" grpc.time_ms=0.593 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1692gitlab # [ 221.505226] gitaly[915]: time="2026-10-21T22:12:30.937Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BT0KFV12C5GRBNB27P2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:12:40.187" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:30.928" grpc.time_ms=9.154 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1693gitlab # [ 221.554592] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:30 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1191694gitlab # [ 225.752467] nix-daemon[2865]: accepted connection from pid 3024, user nixbot1695gitlab # [ 225.820314] gitaly[915]: time="2026-10-21T22:12:35.252Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BY8646BN2XNSZ9BPPFQH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:05.050" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:12:35.251" grpc.time_ms=0.61 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1696gitlab # [ 225.870676] gitaly[915]: time="2026-10-21T22:12:35.303Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BY8646BN2XNSZ9BPPFQH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:12:45.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:12:35.294" grpc.time_ms=8.002 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697gitlab # [ 225.917558] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1421698gitlab # [ 226.145662] nixbot[2690]: {"ts": "2026-10-21T22:12:35.576Z", "level": "info", "logger": "nixbot.effects_run", "msg": "effects discovered", "build_id": 1, "sha": "bc392c49b7b583b9be53b29d569a4dee5a7bd21b", "branch": "master", "pr": null, "allowed": true, "effects_started": false, "effects": []}1699gitlab # [ 226.259365] gitaly[915]: time="2026-10-21T22:12:35.691Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BYNGYDW1DZ9T8W5QKQHH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.683" grpc.time_ms=8.286 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1700gitlab # [ 226.260708] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 601701gitlab # [ 226.312397] gitaly[915]: time="2026-10-21T22:12:35.744Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BYQEVE8H6Z38Q18DZ330 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.736" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1702gitlab # [ 226.324943] gitaly[915]: time="2026-10-21T22:12:35.744Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BYQEVE8H6Z38Q18DZ330 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.736" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1703gitlab # [ 226.325637] gitlab-workhorse[825]: time="2026-10-21T22:12:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671704gitlab # [ 226.326700] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 501705gitlab # [ 226.327602] gitaly[915]: time="2026-10-21T22:12:35.745Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=643 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BYQEVE8H6Z38Q18DZ330 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.736" grpc.time_ms=8.932 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1706gitlab # [ 226.435651] gitaly[915]: time="2026-10-21T22:12:35.867Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BYVAXHS06BXVS05JCJDA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.859" grpc.time_ms=8.289 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1707gitlab # [ 226.437511] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 501708gitlab # [ 226.518728] gitaly[915]: time="2026-10-21T22:12:35.951Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BYXHJHCZP6QZHQDZ9N54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.942" pid=915 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1709gitlab # [ 226.519699] gitaly[915]: time="2026-10-21T22:12:35.951Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BYXHJHCZP6QZHQDZ9N54 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.942" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1710gitlab # [ 226.520756] gitaly[915]: time="2026-10-21T22:12:35.951Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BYXHJHCZP6QZHQDZ9N54 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:12:35.942" grpc.time_ms=8.439 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1711gitlab # [ 226.560503] gitlab-workhorse[825]: time="2026-10-21T22:12:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671712gitlab # [ 226.562837] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:12:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1031713gitlab # [ 233.643146] sidekiq-cluster[2565]: 2026-10-21T22:12:43.074Z pid=2565 tid=xbh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2565, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434552832}1714gitlab # [ 233.958373] sidekiq-cluster[2565]: W, [2026-10-21T22:12:43.390598 #2565] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1715gitlab # [ 234.013275] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:12:43.445Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1716gitlab # [ 236.072861] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:12:45.504Z","message":"GitLab reliable fetch activated!"}1717gitlab # [ 236.073426] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:12:45.504Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1718gitlab # [ 255.651917] postgres[3315]: [3315] ERROR: relation "table_without_models" does not exist1719gitlab # [ 255.653544] postgres[3315]: [3315] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1720gitlab # [ 258.128334] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:07.560Z","message":"Booted Rails 7.2.3.1 application in production environment"}1721gitlab # [ 258.129476] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:07.561Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1722gitlab # [ 258.130677] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:07.563Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1723gitlab # [ 258.132381] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:07.563Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1724gitlab # [ 258.133521] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:07.565Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1725gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 49.54 seconds)1726gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1727gitlab # [ 258.631306] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:08 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 1501728gitlab # [ 258.719406] gitaly[915]: time="2026-10-21T22:13:08.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYB1SJXRJ4C7XWMS2DPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:08.144" grpc.time_ms=6.082 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729gitlab # [ 258.719721] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:08 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 851730gitlab # Enumerating objects: 5, done.1731gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1732gitlab # Delta compression using up to 4 threads1733gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1734gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 272 bytes | 272.00 KiB/s, done.1735gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1736gitlab # [ 259.004180] gitaly[915]: time="2026-10-21T22:13:08.436Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-10-21T22:13:38.328" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-10-21T22:13:08.429" grpc.time_ms=7.046 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1737gitlab # [ 259.036511] gitaly[915]: time="2026-10-21T22:13:08.449Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY duration_ms=80ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/allowed"1738gitlab # [ 259.044604] gitaly[915]: time="2026-10-21T22:13:08.476Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY duration_ms=27ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/pre_receive"1739gitlab # [ 259.049898] gitaly[915]: time="2026-10-21T22:13:08.477Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5311 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:08.368" grpc.time_ms=108.961 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1740gitlab # [ 259.086389] gitaly[915]: time="2026-10-21T22:13:08.518Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:08.518" grpc.time_ms=0.448 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1741gitlab # [ 259.114150] gitaly[915]: time="2026-10-21T22:13:08.546Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4780 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:08.546" grpc.time_ms=0.298 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1742gitlab # [ 259.138788] gitaly[915]: time="2026-10-21T22:13:08.571Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:08.570" grpc.time_ms=0.282 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab # [ 259.194813] gitaly[915]: time="2026-10-21T22:13:08.627Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY duration_ms=30ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/post_receive"1744gitlab # [ 259.195578] gitaly[915]: time="2026-10-21T22:13:08.627Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4805 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:08.596" grpc.time_ms=31.231 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1745gitlab # [ 259.214284] gitaly[915]: time="2026-10-21T22:13:08.646Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY diskcache=cbfaf8d9-75c1-49a2-a6b1-151414697148 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:08.301" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1746gitlab # [ 259.214643] gitaly[915]: time="2026-10-21T22:13:08.646Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=171 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=897024 command.minflt=14080 command.oublock=32 command.real_time_ms=337 command.spawn_token_fork_ms=0 command.system_time_ms=122 command.user_time_ms=49 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=604 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:08.301" grpc.time_ms=345.071 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1747gitlab # [ 259.215524] gitlab-workhorse[825]: time="2026-10-21T22:13:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521748gitlab # [ 259.215947] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:08 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 4401749gitlab # To http://gitlab/root/test-flake.git1750gitlab # bc392c4..448621d master -> master1751gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.81 seconds)1752gitlab: must succeed: git -C /tmp/test-flake rev-parse master1753gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1754gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6'1755gitlab # [ 259.306181] nixbot[2690]: {"ts": "2026-10-21T22:13:08.738Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44944 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1\" 200"}1756gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6', in 0.06 seconds)1757gitlab # [ 259.512652] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:08.944Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a4efc1a89faa679cd68399d7","created_at":"2026-10-21T22:12:04.043Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:04.087Z","job_size_bytes":2,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a4efc1a89faa679cd68399d7: start","job_status":"start","queue_duration_s":64.8567,"scheduling_latency_s":64.856742}1758gitlab # [ 259.669524] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.101Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"a4efc1a89faa679cd68399d7","created_at":"2026-10-21T22:12:04.043Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:04.087Z","job_size_bytes":2,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-a4efc1a89faa679cd68399d7: done: 0.157576 sec","job_status":"done","queue_duration_s":64.8567,"scheduling_latency_s":64.856742,"redis_calls":25,"redis_duration_s":0.005279,"redis_read_bytes":912,"redis_write_bytes":2805,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.002958,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":11,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.066087171,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.157576,"completed_at":"2026-10-21T22:13:09.101Z","load_balancing_strategy":"primary","db_duration_s":0.039922,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1759gitlab # [ 259.671669] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.102Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e418d00ac20584051fe42873","created_at":"2026-10-21T22:12:04.101Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:04.109Z","job_size_bytes":2,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e418d00ac20584051fe42873: start","job_status":"start","queue_duration_s":64.993354,"scheduling_latency_s":64.993369}1760gitlab # [ 259.735918] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.167Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"e418d00ac20584051fe42873","created_at":"2026-10-21T22:12:04.101Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:04.109Z","job_size_bytes":2,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-e418d00ac20584051fe42873: done: 0.065402 sec","job_status":"done","queue_duration_s":64.993354,"scheduling_latency_s":64.993369,"redis_calls":14,"redis_duration_s":0.001965,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05089250100000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.065402,"completed_at":"2026-10-21T22:13:09.167Z","load_balancing_strategy":"primary","db_duration_s":0.012883,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1761gitlab # [ 259.799547] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.169Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"645aa10df3b37f818babf476","created_at":"2026-10-21T22:12:05.048Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:05.057Z","job_size_bytes":5,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-645aa10df3b37f818babf476: start","job_status":"start","queue_duration_s":64.111991,"scheduling_latency_s":64.112007}1762gitlab # [ 259.839241] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.271Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"645aa10df3b37f818babf476","created_at":"2026-10-21T22:12:05.048Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:05.057Z","job_size_bytes":5,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-645aa10df3b37f818babf476: done: 0.102148 sec","job_status":"done","queue_duration_s":64.111991,"scheduling_latency_s":64.112007,"redis_calls":12,"redis_duration_s":0.00183,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000595,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229359,"duration_s":0.102148,"completed_at":"2026-10-21T22:13:09.271Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012194,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1763gitlab # [ 259.840740] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.272Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ce0fa52ece00f73e7d82d78f","created_at":"2026-10-21T22:12:05.089Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:05.095Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ce0fa52ece00f73e7d82d78f: start","job_status":"start","queue_duration_s":64.176407,"scheduling_latency_s":64.176423}1764gitlab # [ 259.970416] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.402Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"ce0fa52ece00f73e7d82d78f","created_at":"2026-10-21T22:12:05.089Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:05.095Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-ce0fa52ece00f73e7d82d78f: done: 0.130025 sec","job_status":"done","queue_duration_s":64.176407,"scheduling_latency_s":64.176423,"redis_calls":11,"redis_duration_s":0.00162,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000414,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.108,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.108,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000230755,"duration_s":0.130025,"completed_at":"2026-10-21T22:13:09.402Z","load_balancing_strategy":"primary","db_duration_s":0.049756,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765gitlab # [ 259.972516] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.403Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3d7153d5ae1e16ea0d400f5f","created_at":"2026-10-21T22:12:05.100Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:05.106Z","job_size_bytes":89,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3d7153d5ae1e16ea0d400f5f: start","job_status":"start","queue_duration_s":64.297341,"scheduling_latency_s":64.297357}1766gitlab # [ 260.049097] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.426Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"3d7153d5ae1e16ea0d400f5f","created_at":"2026-10-21T22:12:05.100Z","trace_propagation_headers":{"sentry-trace":"5f861aa5886e45dfb7f4a5e208057048-19f564d682f640a0","baggage":"sentry-trace_id=5f861aa5886e45dfb7f4a5e208057048,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8AYR56R5W659NG6CTV8J9","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:05.106Z","job_size_bytes":89,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-3d7153d5ae1e16ea0d400f5f: done: 0.023081 sec","job_status":"done","queue_duration_s":64.297341,"scheduling_latency_s":64.297357,"redis_calls":11,"redis_duration_s":0.001475,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243048,"duration_s":0.023081,"completed_at":"2026-10-21T22:13:09.426Z","load_balancing_strategy":"primary","db_duration_s":0.002623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1767gitlab # [ 260.051080] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.427Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 bc392c49b7b583b9be53b29d569a4dee5a7bd21b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4ca5f8b63cc887238ccc275c","created_at":"2026-10-21T22:12:12.614Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-df5309353c2d43ce","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:12:12.663Z","job_size_bytes":185,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4ca5f8b63cc887238ccc275c: start","job_status":"start","queue_duration_s":56.763897,"scheduling_latency_s":56.763912}1768gitlab # [ 260.067293] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:09.437Z","message":"changes: \"0000000000000000000000000000000000000000 bc392c49b7b583b9be53b29d569a4dee5a7bd21b refs/heads/master\\n\""}1769gitlab # [ 260.070307] gitaly[915]: time="2026-10-21T22:13:09.460Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:19.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:09.455" grpc.time_ms=5.676 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770gitlab # [ 260.121270] gitaly[915]: time="2026-10-21T22:13:09.475Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:13:19.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:09.467" grpc.time_ms=7.526 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771gitlab # [ 260.122082] gitaly[915]: time="2026-10-21T22:13:09.513Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-21T22:13:19.056" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:09.506" grpc.time_ms=7.397 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772gitlab # [ 260.156912] gitaly[915]: time="2026-10-21T22:13:09.589Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3932 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:09.588" grpc.time_ms=0.63 pid=915 span.kind=server system=grpc1773gitlab # [ 260.182565] gitaly[915]: time="2026-10-21T22:13:09.614Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3934 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:09.613" grpc.time_ms=0.993 pid=915 span.kind=server system=grpc1774gitlab # [ 260.198271] gitaly[915]: time="2026-10-21T22:13:09.630Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ diskcache=1892a7b4-7dec-4b3d-8cb6-1ffbfd5dcf71 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-21T22:13:19.071" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:09.522" pid=915 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1775gitlab # [ 260.199045] gitaly[915]: time="2026-10-21T22:13:09.630Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=53 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5152 command.oublock=8 command.real_time_ms=103 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-21T22:13:19.071" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:09.522" grpc.time_ms=108.467 pid=915 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1776gitlab # [ 260.235421] gitaly[915]: time="2026-10-21T22:13:09.667Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-10-21T22:13:19.217" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:09.667" grpc.time_ms=0.163 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777gitlab # [ 260.257837] gitaly[915]: time="2026-10-21T22:13:09.690Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=937 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-10-21T22:13:19.230" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:09.681" grpc.time_ms=8.859 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1778gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6'1779gitlab # [ 260.317546] gitaly[915]: time="2026-10-21T22:13:09.749Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=341 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-10-21T22:13:39.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:09.745" grpc.time_ms=3.896 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780gitlab # [ 260.335520] gitaly[915]: time="2026-10-21T22:13:09.767Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-21T22:13:19.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:09.767" grpc.time_ms=0.18 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781gitlab # [ 260.341472] gitaly[915]: time="2026-10-21T22:13:09.773Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=343 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-21T22:13:19.010" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-10-21T22:13:09.770" grpc.time_ms=3.293 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782gitlab # [ 260.355514] gitaly[915]: time="2026-10-21T22:13:09.787Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:19.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:09.783" grpc.time_ms=4.668 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1783gitlab # [ 260.363380] gitaly[915]: time="2026-10-21T22:13:09.795Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:19.031" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:09.791" grpc.time_ms=4.329 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1784gitlab # [ 260.377657] gitaly[915]: time="2026-10-21T22:13:09.810Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-21T22:13:39.102" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:09.802" grpc.time_ms=7.338 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 260.416059] nixbot[2690]: {"ts": "2026-10-21T22:13:09.848Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44950 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1\" 200"}1786gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6', in 0.11 seconds)1787gitlab # [ 260.703168] gitaly[915]: time="2026-10-21T22:13:10.135Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-21T22:13:20.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.134" grpc.time_ms=1.215 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788gitlab # [ 260.723830] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.155Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 bc392c49b7b583b9be53b29d569a4dee5a7bd21b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4ca5f8b63cc887238ccc275c","created_at":"2026-10-21T22:12:12.614Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-df5309353c2d43ce","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:12:12.663Z","job_size_bytes":185,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4ca5f8b63cc887238ccc275c: done: 0.727998 sec","job_status":"done","queue_duration_s":56.763897,"scheduling_latency_s":56.763912,"gitaly_calls":13,"gitaly_duration_s":0.220533,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.03205,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.002827,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005459,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001318,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002638,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.011762,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.008046,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.159,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.173,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.450332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000357867,"exclusive_lock_hold_duration_s":0.019187076,"duration_s":0.727998,"completed_at":"2026-10-21T22:13:10.155Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051269,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1789gitlab # [ 260.799793] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.156Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"779b15a032846273a66ceaef","created_at":"2026-10-21T22:12:20.196Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.205Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-779b15a032846273a66ceaef: start","job_status":"start","queue_duration_s":49.951289,"scheduling_latency_s":49.951304}1790gitlab # [ 260.800593] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.205Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"779b15a032846273a66ceaef","created_at":"2026-10-21T22:12:20.196Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.205Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-779b15a032846273a66ceaef: done: 0.048646 sec","job_status":"done","queue_duration_s":49.951289,"scheduling_latency_s":49.951304,"redis_calls":16,"redis_duration_s":0.0018969999999999998,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.000957,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000223,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222654,"duration_s":0.048646,"completed_at":"2026-10-21T22:13:10.205Z","load_balancing_strategy":"primary","db_duration_s":0.010152,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1791gitlab # [ 260.853581] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.206Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e452d959170beb6749ed3239","created_at":"2026-10-21T22:12:20.206Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.213Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e452d959170beb6749ed3239: start","job_status":"start","queue_duration_s":49.992882,"scheduling_latency_s":49.992898}1792gitlab # [ 260.854229] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.261Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"e452d959170beb6749ed3239","created_at":"2026-10-21T22:12:20.206Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.213Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-e452d959170beb6749ed3239: done: 0.054801 sec","job_status":"done","queue_duration_s":49.992882,"scheduling_latency_s":49.992898,"redis_calls":21,"redis_duration_s":0.0027,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001185,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000771,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000744,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229918,"duration_s":0.054801,"completed_at":"2026-10-21T22:13:10.261Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1793gitlab # [ 260.872656] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.262Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8f31c68b0e197f580db30f0a","created_at":"2026-10-21T22:12:20.336Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.343Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8f31c68b0e197f580db30f0a: start","job_status":"start","queue_duration_s":49.919059,"scheduling_latency_s":49.919074}1794gitlab # [ 261.001366] gitaly[915]: time="2026-10-21T22:13:10.433Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:10.433" grpc.time_ms=0.482 pid=915 span.kind=server system=grpc1795gitlab # [ 261.037491] gitaly[915]: time="2026-10-21T22:13:10.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:10.469" grpc.time_ms=0.246 pid=915 span.kind=server system=grpc1796gitlab # [ 261.073646] gitaly[915]: time="2026-10-21T22:13:10.505Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:10.505" grpc.time_ms=0.413 pid=915 span.kind=server system=grpc1797gitlab # [ 261.091255] gitaly[915]: time="2026-10-21T22:13:10.523Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 diskcache=ae4ff073-2e80-48e8-83a7-a3b081db0f1a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:40.012" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:10.412" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 261.091649] gitaly[915]: time="2026-10-21T22:13:10.524Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7402 command.oublock=0 command.real_time_ms=103 command.spawn_token_fork_ms=0 command.system_time_ms=63 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:40.012" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:10.412" grpc.time_ms=111.149 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1799gitlab # [ 261.187389] gitaly[915]: time="2026-10-21T22:13:10.619Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-21T22:13:40.218" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.618" grpc.time_ms=1.126 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800gitlab # [ 261.226904] gitaly[915]: time="2026-10-21T22:13:10.659Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8BF78B3PNXHN369FJTYZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:40.257" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.658" grpc.time_ms=0.907 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1801gitlab # [ 261.239224] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.671Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8f31c68b0e197f580db30f0a","created_at":"2026-10-21T22:12:20.336Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.343Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2565,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8f31c68b0e197f580db30f0a: rescheduled"}1802gitlab # [ 261.246478] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.678Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8f31c68b0e197f580db30f0a","created_at":"2026-10-21T22:12:20.336Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-46f87a53ed9e4dee","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:12:20.343Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8f31c68b0e197f580db30f0a: done: 0.416331 sec","job_status":"done","queue_duration_s":49.919059,"scheduling_latency_s":49.919074,"gitaly_calls":3,"gitaly_duration_s":0.120515,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.022932,"redis_read_bytes":460,"redis_write_bytes":29289,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001008,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001525,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.007917,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003655,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15576,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004957,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000571,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000565,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001726,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.081,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.084,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.237248,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.376569369,"duration_s":0.416331,"completed_at":"2026-10-21T22:13:10.678Z","load_balancing_strategy":"primary","db_duration_s":0.046128,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1803gitlab # [ 261.318414] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.680Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","bc392c49b7b583b9be53b29d569a4dee5a7bd21b 448621d6100f54bfb6e7a655e2553a1ccde7a1a6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d1e2970749b05e946f693c6d","created_at":"2026-10-21T22:13:08.616Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-e1448c48d3414eae","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:13:08.617Z","job_size_bytes":185,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d1e2970749b05e946f693c6d: start","job_status":"start","queue_duration_s":2.062629,"scheduling_latency_s":2.062647}1804gitlab # [ 261.319196] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.689Z","message":"changes: \"bc392c49b7b583b9be53b29d569a4dee5a7bd21b 448621d6100f54bfb6e7a655e2553a1ccde7a1a6 refs/heads/master\\n\""}1805gitlab # [ 261.319955] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.728Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"569acfc31a72d1a2e93b0990","created_at":"2026-10-21T22:13:10.726Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"d27faa180ab794404868a9ba","job_size_bytes":46,"pid":2565,"job_status":"deduplicated","message":"ProjectCacheWorker JID-569acfc31a72d1a2e93b0990: deduplicated: until executing","deduplication.type":"until executing"}1806gitlab # [ 261.320762] gitaly[915]: time="2026-10-21T22:13:10.710Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:20.253" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:10.704" grpc.time_ms=5.876 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab # [ 261.324719] gitaly[915]: time="2026-10-21T22:13:10.723Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-10-21T22:13:20.263" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:10.713" grpc.time_ms=9.659 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 261.371127] gitaly[915]: time="2026-10-21T22:13:10.752Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-10-21T22:13:20.002" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:10.742" grpc.time_ms=9.953 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809gitlab # [ 261.371827] gitaly[915]: time="2026-10-21T22:13:10.767Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=654 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-10-21T22:13:40.057" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.757" grpc.time_ms=9.734 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab # [ 261.372423] gitaly[915]: time="2026-10-21T22:13:10.778Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=345 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-10-21T22:13:20.035" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-10-21T22:13:10.775" grpc.time_ms=3.204 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6'1812gitlab # [ 261.374896] gitaly[915]: time="2026-10-21T22:13:10.791Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:20.046" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:10.786" grpc.time_ms=4.789 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 261.411934] gitaly[915]: time="2026-10-21T22:13:10.844Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-10-21T22:13:20.103" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.843" grpc.time_ms=0.496 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6', in 0.05 seconds)1815gitlab # [ 261.422169] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.854Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","bc392c49b7b583b9be53b29d569a4dee5a7bd21b 448621d6100f54bfb6e7a655e2553a1ccde7a1a6 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d1e2970749b05e946f693c6d","created_at":"2026-10-21T22:13:08.616Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-e1448c48d3414eae","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-10-21T22:13:08.617Z","job_size_bytes":185,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d1e2970749b05e946f693c6d: done: 0.173915 sec","job_status":"done","queue_duration_s":2.062629,"scheduling_latency_s":2.062647,"gitaly_calls":7,"gitaly_duration_s":0.057138,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.016346,"redis_read_bytes":501,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.001452,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000651,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001985,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.006279,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.005979,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.001708876,"exclusive_lock_hold_duration_s":0.013155862,"duration_s":0.173915,"completed_at":"2026-10-21T22:13:10.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016633,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1816gitlab # [ 261.444313] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.855Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d27faa180ab794404868a9ba","created_at":"2026-10-21T22:13:09.477Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:09.491Z","job_size_bytes":46,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d27faa180ab794404868a9ba: start","job_status":"start","queue_duration_s":1.363995,"scheduling_latency_s":1.364011}1817gitlab # [ 261.459189] gitaly[915]: time="2026-10-21T22:13:10.891Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-10-22T04:13:10.888" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:10.888" grpc.time_ms=2.136 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 261.503881] gitaly[915]: time="2026-10-21T22:13:10.903Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=653 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-21T22:13:40.498" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.898" grpc.time_ms=4.917 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 261.504777] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.922Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d27faa180ab794404868a9ba","created_at":"2026-10-21T22:13:09.477Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:09.491Z","job_size_bytes":46,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d27faa180ab794404868a9ba: done: 0.066836 sec","job_status":"done","queue_duration_s":1.363995,"scheduling_latency_s":1.364011,"gitaly_calls":2,"gitaly_duration_s":0.009865,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.007704000000000001,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.000755,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000361,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005303,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035232,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204215,"duration_s":0.066836,"completed_at":"2026-10-21T22:13:10.922Z","load_balancing_strategy":"primary","db_duration_s":0.01067,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1820gitlab # [ 261.526175] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:10.923Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7581985af4937444d628ea12","created_at":"2026-10-21T22:13:09.500Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:09.503Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7581985af4937444d628ea12: start","job_status":"start","queue_duration_s":1.41968,"scheduling_latency_s":1.419695}1821gitlab # [ 261.576914] nixbot[2690]: {"ts": "2026-10-21T22:13:10.899Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44954 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1\" 200"}1822gitlab # [ 261.590066] gitaly[915]: time="2026-10-21T22:13:11.022Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ diskcache=64042581-2518-4933-b5a5-d6c5203372a5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-22T04:13:10.937" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.937" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 261.590452] gitaly[915]: time="2026-10-21T22:13:11.022Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1285 command.oublock=0 command.real_time_ms=83 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-22T04:13:10.937" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:10.937" grpc.time_ms=85.012 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 261.635648] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:11.067Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7581985af4937444d628ea12","created_at":"2026-10-21T22:13:09.500Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:09.503Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7581985af4937444d628ea12: done: 0.144648 sec","job_status":"done","queue_duration_s":1.41968,"scheduling_latency_s":1.419695,"gitaly_calls":1,"gitaly_duration_s":0.107926,"redis_calls":15,"redis_duration_s":0.002182,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000361,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000678,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.129655026,"duration_s":0.144648,"completed_at":"2026-10-21T22:13:11.067Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1825gitlab # [ 261.637729] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:11.068Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"828e32073d66e8bc33f4b11a","created_at":"2026-10-21T22:13:09.662Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:09.664Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-828e32073d66e8bc33f4b11a: start","job_status":"start","queue_duration_s":1.404138,"scheduling_latency_s":1.404153}1826gitlab # [ 261.709481] gitaly[915]: time="2026-10-21T22:13:11.141Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-10-21T22:13:41.035" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:11.135" grpc.time_ms=6.137 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab # [ 261.717641] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:11.149Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"828e32073d66e8bc33f4b11a","created_at":"2026-10-21T22:13:09.662Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:09.664Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-828e32073d66e8bc33f4b11a: done: 0.08079 sec","job_status":"done","queue_duration_s":1.404138,"scheduling_latency_s":1.404153,"gitaly_calls":1,"gitaly_duration_s":0.008018,"redis_calls":16,"redis_duration_s":0.003017,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000262,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001034,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001142,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.08079,"completed_at":"2026-10-21T22:13:11.149Z","load_balancing_strategy":"primary","db_duration_s":0.049075,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1828gitlab # [ 261.761675] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:11.193Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1a4b8085c32f4df8b82f7b28","created_at":"2026-10-21T22:13:10.004Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2c751ef2281838b895bc56334c6c7d7ec581d5c3c1fc942a3a9946ab010b2bba","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.007Z","job_size_bytes":467,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1a4b8085c32f4df8b82f7b28: start","job_status":"start","queue_duration_s":1.185678,"scheduling_latency_s":1.185703}1829gitlab # [ 261.791965] gitaly[915]: time="2026-10-21T22:13:11.224Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:41.123" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:11.223" grpc.time_ms=0.519 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1830gitlab # [ 261.809371] gitaly[915]: time="2026-10-21T22:13:11.241Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-21T22:13:21.105" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:11.235" grpc.time_ms=5.904 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1831gitlab # [ 261.899941] gitaly[915]: time="2026-10-21T22:13:11.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-21T22:13:41.230" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:11.330" grpc.time_ms=1.188 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab # [ 261.927802] gitaly[915]: time="2026-10-21T22:13:11.340Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=19 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-21T22:13:41.237" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:11.337" grpc.time_ms=2.789 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1833gitlab # [ 262.001900] gitaly[915]: time="2026-10-21T22:13:11.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=621 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:21.296" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:11.426" grpc.time_ms=7.622 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1834gitlab # [ 262.421444] gitaly[915]: time="2026-10-21T22:13:11.853Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=960 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-21T22:13:41.741" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:11.841" grpc.time_ms=11.696 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6'1836gitlab # [ 262.430855] gitaly[915]: time="2026-10-21T22:13:11.863Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8B7BYPSM67WKVRG5PD0BZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-21T22:13:41.755" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:11.855" grpc.time_ms=7.408 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1837gitlab # [ 262.499998] nixbot[2690]: {"ts": "2026-10-21T22:13:11.932Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44968 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1\" 200"}1838gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6', in 0.04 seconds)1839gitlab # [ 262.506812] sidekiq-cluster[2565]: {"severity":"WARN","time":"2026-10-21T22:13:11.939Z","class":"CreatePipelineWorker","correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"bc392c49b7b583b9be53b29d569a4dee5a7bd21b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"bc392c49b7b583b9be53b29d569a4dee5a7bd21b","ref":"refs/heads/master"},"retry":0}1840gitlab # [ 262.512189] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:11.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"1a4b8085c32f4df8b82f7b28","created_at":"2026-10-21T22:13:10.004Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2c751ef2281838b895bc56334c6c7d7ec581d5c3c1fc942a3a9946ab010b2bba","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.007Z","job_size_bytes":467,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-1a4b8085c32f4df8b82f7b28: done: 0.750952 sec","job_status":"done","queue_duration_s":1.185678,"scheduling_latency_s":1.185703,"gitaly_calls":7,"gitaly_duration_s":0.120179,"redis_calls":51,"redis_duration_s":0.007889,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.000734,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003471,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002172,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.563972,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220139,"duration_s":0.750952,"completed_at":"2026-10-21T22:13:11.944Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054122,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1841gitlab # [ 262.556582] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:11.945Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"8359be80-f65b-4e2f-8e86-10483db47a10\"}"],"class":"WebHookWorker","jid":"326d96487116ae01ca6dd5b8","created_at":"2026-10-21T22:13:10.114Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e66d9634b137fd2a9b1006035bf65bf1b8b4e128d965e918472750ffa9aceb12","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.119Z","job_size_bytes":1751,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-326d96487116ae01ca6dd5b8: start","job_status":"start","queue_duration_s":1.826526,"scheduling_latency_s":1.826541}1842gitlab # [ 262.609614] nixbot[2690]: {"ts": "2026-10-21T22:13:12.041Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "dca336db-382a-4ec9-8508-e7955f15ea21", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "bc392c49b7b583b9be53b29d569a4dee5a7bd21b", "pr": null}1843gitlab # [ 262.613704] nixbot[2690]: {"ts": "2026-10-21T22:13:12.046Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:44972 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1844gitlab # [ 262.628770] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.060Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"8359be80-f65b-4e2f-8e86-10483db47a10\"}"],"class":"WebHookWorker","jid":"326d96487116ae01ca6dd5b8","created_at":"2026-10-21T22:13:10.114Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-d1340637c5b34aaf","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e66d9634b137fd2a9b1006035bf65bf1b8b4e128d965e918472750ffa9aceb12","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.119Z","job_size_bytes":1751,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-326d96487116ae01ca6dd5b8: done: 0.115102 sec","job_status":"done","queue_duration_s":1.826526,"scheduling_latency_s":1.826541,"redis_calls":19,"redis_duration_s":0.003113,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000962,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000232,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03873676699998896,"cpu_s":0.065958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000269587,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.115102,"completed_at":"2026-10-21T22:13:12.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1845gitlab # [ 262.673987] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9dcc631548dd4318e084d0c9","created_at":"2026-10-21T22:13:10.402Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.405Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9dcc631548dd4318e084d0c9: start","job_status":"start","queue_duration_s":1.700397,"scheduling_latency_s":1.700425}1846gitlab # [ 262.724060] gitaly[915]: time="2026-10-21T22:13:12.156Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2811NHBX3QNPCGSE0GE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.149" grpc.time_ms=6.863 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1847gitlab # [ 262.725541] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:12 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 911848gitlab # [ 262.765896] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9dcc631548dd4318e084d0c9","created_at":"2026-10-21T22:13:10.402Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.405Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9dcc631548dd4318e084d0c9: done: 0.092027 sec","job_status":"done","queue_duration_s":1.700397,"scheduling_latency_s":1.700425,"redis_calls":10,"redis_duration_s":0.002029,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000367924,"duration_s":0.092027,"completed_at":"2026-10-21T22:13:12.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012567,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1849gitlab # [ 262.806200] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.238Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"555288fa7275ce74d80c858a","created_at":"2026-10-21T22:13:10.529Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.535Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-555288fa7275ce74d80c858a: start","job_status":"start","queue_duration_s":1.702664,"scheduling_latency_s":1.702689}1850gitlab # [ 262.824193] gitaly[915]: time="2026-10-21T22:13:12.256Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2AYMGQ9VB9RRENH6GEV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.249" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1851gitlab # [ 262.824823] gitaly[915]: time="2026-10-21T22:13:12.256Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2AYMGQ9VB9RRENH6GEV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.249" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1852gitlab # [ 262.825641] gitlab-workhorse[825]: time="2026-10-21T22:13:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671853gitlab # [ 262.826454] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 981854gitlab # [ 262.828375] gitaly[915]: time="2026-10-21T22:13:12.256Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2AYMGQ9VB9RRENH6GEV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.249" grpc.time_ms=7.623 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1855gitlab # [ 262.859041] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.291Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"555288fa7275ce74d80c858a","created_at":"2026-10-21T22:13:10.529Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.535Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-555288fa7275ce74d80c858a: done: 0.052831 sec","job_status":"done","queue_duration_s":1.702664,"scheduling_latency_s":1.702689,"redis_calls":10,"redis_duration_s":0.00743,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006052,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000276292,"duration_s":0.052831,"completed_at":"2026-10-21T22:13:12.291Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 262.863351] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6d014e56cfadcc287e69bbab","created_at":"2026-10-21T22:13:10.549Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.555Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6d014e56cfadcc287e69bbab: start","job_status":"start","queue_duration_s":1.74006,"scheduling_latency_s":1.740077}1857gitlab # [ 262.910943] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.343Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"6d014e56cfadcc287e69bbab","created_at":"2026-10-21T22:13:10.549Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.555Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-6d014e56cfadcc287e69bbab: done: 0.047494 sec","job_status":"done","queue_duration_s":1.74006,"scheduling_latency_s":1.740077,"redis_calls":10,"redis_duration_s":0.002103,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000353,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000240533,"duration_s":0.047494,"completed_at":"2026-10-21T22:13:12.343Z","load_balancing_strategy":"primary","db_duration_s":0.025264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1858gitlab # [ 262.916853] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.345Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"873da0a36421ab3cbaeb673f","created_at":"2026-10-21T22:13:10.569Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.573Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-873da0a36421ab3cbaeb673f: start","job_status":"start","queue_duration_s":1.772166,"scheduling_latency_s":1.772181}1859gitlab # [ 262.966976] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.374Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"873da0a36421ab3cbaeb673f","created_at":"2026-10-21T22:13:10.569Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.573Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-873da0a36421ab3cbaeb673f: done: 0.028278 sec","job_status":"done","queue_duration_s":1.772166,"scheduling_latency_s":1.772181,"redis_calls":13,"redis_duration_s":0.003352,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000462,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000243607,"duration_s":0.028278,"completed_at":"2026-10-21T22:13:12.373Z","load_balancing_strategy":"primary","db_duration_s":0.005024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1860gitlab # [ 262.972350] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f5fb814721f3aa65e41c906a","created_at":"2026-10-21T22:13:10.574Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.576Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f5fb814721f3aa65e41c906a: start","job_status":"start","queue_duration_s":1.798198,"scheduling_latency_s":1.798212}1861gitlab # [ 263.015657] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.396Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f5fb814721f3aa65e41c906a","created_at":"2026-10-21T22:13:10.574Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.576Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f5fb814721f3aa65e41c906a: done: 0.021068 sec","job_status":"done","queue_duration_s":1.798198,"scheduling_latency_s":1.798212,"redis_calls":10,"redis_duration_s":0.001394,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000267,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000269,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000216508,"duration_s":0.021068,"completed_at":"2026-10-21T22:13:12.396Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1862gitlab # [ 263.056562] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3cc04dc426cf169c6528bb1f","created_at":"2026-10-21T22:13:10.577Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.580Z","job_size_bytes":19,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3cc04dc426cf169c6528bb1f: start","job_status":"start","queue_duration_s":1.816416,"scheduling_latency_s":1.816429}1863gitlab # [ 263.057233] gitlab-workhorse[825]: time="2026-10-21T22:13:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3371864gitlab # [ 263.057953] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1861865gitlab # [ 263.058962] gitaly[915]: time="2026-10-21T22:13:12.444Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2E2DE3FBWCSNE97GWFN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.426" pid=915 remote_ip="2001:db8:1::1" request_sha=3efbfaa09d7251d3b9bf7fb2270cf2afa00e7b62 response_bytes=337 span.kind=server system=grpc1866gitlab # [ 263.059712] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.420Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3cc04dc426cf169c6528bb1f","created_at":"2026-10-21T22:13:10.577Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.580Z","job_size_bytes":19,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3cc04dc426cf169c6528bb1f: done: 0.023078 sec","job_status":"done","queue_duration_s":1.816416,"scheduling_latency_s":1.816429,"redis_calls":11,"redis_duration_s":0.005229,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001894,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002679,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000209245,"duration_s":0.023078,"completed_at":"2026-10-21T22:13:12.420Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002886,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 263.124431] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.421Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e6720beb9d4da87851b2fdd3","created_at":"2026-10-21T22:13:10.582Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.585Z","job_size_bytes":66,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e6720beb9d4da87851b2fdd3: start","job_status":"start","queue_duration_s":1.835887,"scheduling_latency_s":1.835902}1868gitlab # [ 263.125153] gitaly[915]: time="2026-10-21T22:13:12.444Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2E2DE3FBWCSNE97GWFN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.426" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1869gitlab # [ 263.125881] nixbot[2690]: {"ts": "2026-10-21T22:13:12.547Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1870gitlab # [ 263.126837] nixbot[2690]: {"ts": "2026-10-21T22:13:12.549Z", "level": "info", "logger": "nixbot.after_build", "msg": "reused build: replaying effect statuses", "build_id": 1, "sha": "bc392c49b7b583b9be53b29d569a4dee5a7bd21b"}1871gitlab # [ 263.129584] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.471Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"e6720beb9d4da87851b2fdd3","created_at":"2026-10-21T22:13:10.582Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.585Z","job_size_bytes":66,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-e6720beb9d4da87851b2fdd3: done: 0.050262 sec","job_status":"done","queue_duration_s":1.835887,"scheduling_latency_s":1.835902,"redis_calls":10,"redis_duration_s":0.002086,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000369,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001386,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030339,"duration_s":0.050262,"completed_at":"2026-10-21T22:13:12.471Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1872gitlab # [ 263.178185] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.472Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f73df8394b2431d8aa48d0e4","created_at":"2026-10-21T22:13:10.585Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.588Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f73df8394b2431d8aa48d0e4: start","job_status":"start","queue_duration_s":1.883693,"scheduling_latency_s":1.883711}1873gitlab # [ 263.185778] gitaly[915]: time="2026-10-21T22:13:12.444Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1195 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2E2DE3FBWCSNE97GWFN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:12.426" grpc.time_ms=18.42 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1874gitlab # [ 263.202428] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.509Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f73df8394b2431d8aa48d0e4","created_at":"2026-10-21T22:13:10.585Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.588Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f73df8394b2431d8aa48d0e4: done: 0.036846 sec","job_status":"done","queue_duration_s":1.883693,"scheduling_latency_s":1.883711,"redis_calls":10,"redis_duration_s":0.00507,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00082,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000886985,"duration_s":0.036846,"completed_at":"2026-10-21T22:13:12.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1875gitlab # [ 263.259208] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.512Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a099e494b161fb0dc68f5b15","created_at":"2026-10-21T22:13:10.593Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.595Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a099e494b161fb0dc68f5b15: start","job_status":"start","queue_duration_s":1.917129,"scheduling_latency_s":1.917148}1876gitlab # [ 263.260813] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.543Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"a099e494b161fb0dc68f5b15","created_at":"2026-10-21T22:13:10.593Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.595Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-a099e494b161fb0dc68f5b15: done: 0.030553 sec","job_status":"done","queue_duration_s":1.917129,"scheduling_latency_s":1.917148,"redis_calls":10,"redis_duration_s":0.001987,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000412,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016683,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000351721,"duration_s":0.030553,"completed_at":"2026-10-21T22:13:12.543Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1877gitlab # [ 263.305793] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.545Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8acd43a60e09e1c4a17230b7","created_at":"2026-10-21T22:13:10.596Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.598Z","job_size_bytes":6,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8acd43a60e09e1c4a17230b7: start","job_status":"start","queue_duration_s":1.946717,"scheduling_latency_s":1.946739}1878gitlab # [ 263.349178] gitaly[915]: time="2026-10-21T22:13:12.672Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:42.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.671" grpc.time_ms=0.467 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 263.350144] gitaly[915]: time="2026-10-21T22:13:12.696Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY diskcache=147ee14a-2cb0-49d2-a37c-01e863cf0df1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-22T04:13:12.687" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.687" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 263.350850] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 2141881gitlab # [ 263.351599] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.569Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8acd43a60e09e1c4a17230b7","created_at":"2026-10-21T22:13:10.596Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.598Z","job_size_bytes":6,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8acd43a60e09e1c4a17230b7: done: 0.023483 sec","job_status":"done","queue_duration_s":1.946717,"scheduling_latency_s":1.946739,"redis_calls":10,"redis_duration_s":0.004543,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000941181,"duration_s":0.023483,"completed_at":"2026-10-21T22:13:12.569Z","load_balancing_strategy":"primary","db_duration_s":0.001706,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1882gitlab # [ 263.397795] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.570Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cf22aaf9cb6b84070e24a8aa","created_at":"2026-10-21T22:13:10.599Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.601Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cf22aaf9cb6b84070e24a8aa: start","job_status":"start","queue_duration_s":1.968506,"scheduling_latency_s":1.96852}1883gitlab # [ 263.398635] gitaly[915]: time="2026-10-21T22:13:12.697Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=314 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-10-22T04:13:12.687" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.687" grpc.time_ms=9.208 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 263.402970] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.597Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cf22aaf9cb6b84070e24a8aa","created_at":"2026-10-21T22:13:10.599Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.601Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cf22aaf9cb6b84070e24a8aa: done: 0.027072 sec","job_status":"done","queue_duration_s":1.968506,"scheduling_latency_s":1.96852,"redis_calls":10,"redis_duration_s":0.001529,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000317,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017226,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00019807,"duration_s":0.027072,"completed_at":"2026-10-21T22:13:12.597Z","load_balancing_strategy":"primary","db_duration_s":0.004893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1885gitlab # [ 263.448666] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.598Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5b0994a438f24c79a3d81de5","created_at":"2026-10-21T22:13:10.606Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.608Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5b0994a438f24c79a3d81de5: start","job_status":"start","queue_duration_s":1.989531,"scheduling_latency_s":1.989545}1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6'1887gitlab # [ 263.458215] gitaly[915]: time="2026-10-21T22:13:12.729Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:42.628" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.729" grpc.time_ms=0.454 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888gitlab # [ 263.469577] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1001889gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6', in 0.04 seconds)1890gitlab # [ 263.471836] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.648Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5b0994a438f24c79a3d81de5","created_at":"2026-10-21T22:13:10.606Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.608Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5b0994a438f24c79a3d81de5: done: 0.049923 sec","job_status":"done","queue_duration_s":1.989531,"scheduling_latency_s":1.989545,"redis_calls":14,"redis_duration_s":0.003918,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000227,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002178,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229079,"duration_s":0.049923,"completed_at":"2026-10-21T22:13:12.648Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016435,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1891gitlab # [ 263.535656] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.649Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"05e8f3829f03d87ec0542c5f","created_at":"2026-10-21T22:13:10.671Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.673Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-05e8f3829f03d87ec0542c5f: start","job_status":"start","queue_duration_s":1.976617,"scheduling_latency_s":1.976634}1892gitlab # [ 263.536587] gitaly[915]: time="2026-10-21T22:13:12.730Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:22.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:12.724" grpc.time_ms=5.383 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 263.537543] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.670Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"05e8f3829f03d87ec0542c5f","created_at":"2026-10-21T22:13:10.671Z","trace_propagation_headers":{"sentry-trace":"1f1e0d58a49f4459a1529e00bab3b080-852056e9e3af47d0","baggage":"sentry-trace_id=1f1e0d58a49f4459a1529e00bab3b080,sentry-release=Unknown"},"correlation_id":"01M5G8BF78B3PNXHN369FJTYZ2","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.673Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-05e8f3829f03d87ec0542c5f: done: 0.02084 sec","job_status":"done","queue_duration_s":1.976617,"scheduling_latency_s":1.976634,"redis_calls":8,"redis_duration_s":0.001219,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00089,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02084,"completed_at":"2026-10-21T22:13:12.670Z","load_balancing_strategy":"primary","db_duration_s":0.002888,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1894gitlab # [ 263.579836] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.671Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"76672082e3a92fb7d9c154da","created_at":"2026-10-21T22:13:10.735Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"7581985af4937444d628ea12","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.738Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-76672082e3a92fb7d9c154da: start","job_status":"start","queue_duration_s":1.933481,"scheduling_latency_s":1.9335}1895gitlab # [ 263.625224] gitaly[915]: time="2026-10-21T22:13:12.736Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-21T22:13:22.001" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:12.731" grpc.time_ms=5.056 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896gitlab # [ 263.626218] nixbot[2690]: {"ts": "2026-10-21T22:13:12.976Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:47880 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1\" 200"}1897gitlab # [ 263.626754] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.712Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"76672082e3a92fb7d9c154da","created_at":"2026-10-21T22:13:10.735Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"7581985af4937444d628ea12","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.738Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-76672082e3a92fb7d9c154da: done: 0.040124 sec","job_status":"done","queue_duration_s":1.933481,"scheduling_latency_s":1.9335,"gitaly_calls":1,"gitaly_duration_s":0.011365,"redis_calls":12,"redis_duration_s":0.002206,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000433,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.025324168,"duration_s":0.040124,"completed_at":"2026-10-21T22:13:12.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1898gitlab # [ 263.647033] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:12.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d868eb1213af9970c9448dce","created_at":"2026-10-21T22:13:10.826Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0c4d59369b1dc87aa04a6a30dd06efc02585d8452af94f9d7424dd568b34c82b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.827Z","job_size_bytes":467,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d868eb1213af9970c9448dce: start","job_status":"start","queue_duration_s":1.885319,"scheduling_latency_s":1.885519}1899gitlab # [ 263.687769] gitaly[915]: time="2026-10-21T22:13:12.766Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-21T22:13:42.665" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.765" grpc.time_ms=1.001 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1900gitlab # [ 263.688653] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/bc392c49b7b583b9be53b29d569a4dee5a7bd21b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2081901gitlab # [ 263.689117] gitaly[915]: time="2026-10-21T22:13:12.770Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=31 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-10-21T22:13:42.668" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.768" grpc.time_ms=1.548 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902gitlab # [ 263.691924] gitaly[915]: time="2026-10-21T22:13:12.792Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:22.047" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:12.787" grpc.time_ms=5.131 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903gitlab # [ 263.704337] gitaly[915]: time="2026-10-21T22:13:12.819Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2YBTVKR3Y9JG5TWTRR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:42.218" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.818" grpc.time_ms=0.659 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1904gitlab # [ 263.716545] gitaly[915]: time="2026-10-21T22:13:12.848Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2YBTVKR3Y9JG5TWTRR6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:22.103" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:12.843" grpc.time_ms=5.212 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1905gitlab # [ 263.729918] gitaly[915]: time="2026-10-21T22:13:12.943Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D31NVQ27D3Y922T4ESZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:42.842" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:12.942" grpc.time_ms=0.541 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1906gitlab # [ 263.742578] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 441907gitlab # [ 263.744047] gitaly[915]: time="2026-10-21T22:13:13.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D31NVQ27D3Y922T4ESZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:23.028" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:13.049" grpc.time_ms=6.178 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908gitlab # [ 263.785791] gitaly[915]: time="2026-10-21T22:13:13.159Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D38V46D2TRXJSH5XMK2C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.152" grpc.time_ms=7.064 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909gitlab # [ 263.787070] sidekiq-cluster[2565]: {"severity":"WARN","time":"2026-10-21T22:13:13.193Z","class":"CreatePipelineWorker","correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"bc392c49b7b583b9be53b29d569a4dee5a7bd21b","after":"448621d6100f54bfb6e7a655e2553a1ccde7a1a6","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"448621d6100f54bfb6e7a655e2553a1ccde7a1a6","ref":"refs/heads/master"},"retry":0}1910gitlab # [ 263.787701] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.197Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d868eb1213af9970c9448dce","created_at":"2026-10-21T22:13:10.826Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0c4d59369b1dc87aa04a6a30dd06efc02585d8452af94f9d7424dd568b34c82b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.827Z","job_size_bytes":467,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d868eb1213af9970c9448dce: done: 0.484616 sec","job_status":"done","queue_duration_s":1.885319,"scheduling_latency_s":1.885519,"gitaly_calls":7,"gitaly_duration_s":0.045307,"redis_calls":33,"redis_duration_s":0.005068,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000739,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000799,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002843,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000687,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.405863,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.484616,"completed_at":"2026-10-21T22:13:13.197Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013629,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1911gitlab # [ 263.822822] nixbot[2690]: {"ts": "2026-10-21T22:13:13.217Z", "level": "info", "logger": "nixbot.webhooks", "msg": "webhook accepted", "delivery": "765cffe1-ba1d-40a0-ad14-0f18273cc971", "event": "ChangeRequest", "forge": "gitlab", "repo_id": "1", "branch": "master", "sha": "448621d6100f54bfb6e7a655e2553a1ccde7a1a6", "pr": null}1912gitlab # [ 263.826104] nixbot[2690]: {"ts": "2026-10-21T22:13:13.226Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:47892 - \"POST /webhooks/gitlab HTTP/1.1\" 202"}1913gitlab # [ 263.827839] gitlab-workhorse[825]: time="2026-10-21T22:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671914gitlab # [ 263.829825] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 451915gitlab # [ 263.831700] gitaly[915]: time="2026-10-21T22:13:13.175Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=967 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=7 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-10-21T22:13:43.062" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:13.163" grpc.time_ms=12.038 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1916gitlab # [ 263.880710] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.198Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ece78161-3d4f-46b1-8f61-52483f7e597d\"}"],"class":"WebHookWorker","jid":"b3b72bef3ff8d66e8caf0cec","created_at":"2026-10-21T22:13:10.835Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3cc981674686cf3cf2941c6c4f0885008854b151dacbe042c8caa12690980826","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.836Z","job_size_bytes":1749,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b3b72bef3ff8d66e8caf0cec: start","job_status":"start","queue_duration_s":2.362182,"scheduling_latency_s":2.362199}1917gitlab # [ 263.882246] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.236Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ece78161-3d4f-46b1-8f61-52483f7e597d\"}"],"class":"WebHookWorker","jid":"b3b72bef3ff8d66e8caf0cec","created_at":"2026-10-21T22:13:10.835Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-22885bbddf3e407f","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3cc981674686cf3cf2941c6c4f0885008854b151dacbe042c8caa12690980826","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.836Z","job_size_bytes":1749,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-b3b72bef3ff8d66e8caf0cec: done: 0.037779 sec","job_status":"done","queue_duration_s":2.362182,"scheduling_latency_s":2.362199,"redis_calls":14,"redis_duration_s":0.00458,"redis_read_bytes":25,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000482,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003061,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.013944788999992852,"cpu_s":0.016045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.037779,"completed_at":"2026-10-21T22:13:13.236Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1918gitlab # [ 263.910284] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 661919gitlab # [ 263.912452] gitaly[915]: time="2026-10-21T22:13:13.185Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8CYFEPBYWBCY09P9Y6JFY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-10-21T22:13:43.077" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:13.177" grpc.time_ms=8.091 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 263.954632] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ea3389f266eb375c8fa0f5d7","created_at":"2026-10-21T22:13:10.912Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-8dd460b87c4842b3","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.914Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ea3389f266eb375c8fa0f5d7: start","job_status":"start","queue_duration_s":2.324731,"scheduling_latency_s":2.324749}1921gitlab # [ 263.955555] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ea3389f266eb375c8fa0f5d7","created_at":"2026-10-21T22:13:10.912Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-8dd460b87c4842b3","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:10.914Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ea3389f266eb375c8fa0f5d7: done: 0.047946 sec","job_status":"done","queue_duration_s":2.324731,"scheduling_latency_s":2.324749,"redis_calls":19,"redis_duration_s":0.011361,"redis_read_bytes":21,"redis_write_bytes":4288,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005075,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000672,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2259,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002773,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002841,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.006429867,"duration_s":0.047946,"completed_at":"2026-10-21T22:13:13.287Z","load_balancing_strategy":"primary","db_duration_s":0.009127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1922gitlab # [ 263.982898] gitlab-workhorse[825]: time="2026-10-21T22:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671923gitlab # [ 263.983646] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 501924gitlab # [ 263.985639] gitaly[915]: time="2026-10-21T22:13:13.207Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3AAXDMC9VWGD8V7YGG8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.200" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1925gitlab # [ 264.029272] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.288Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","326d96487116ae01ca6dd5b8"],"class":"WebHooks::LogExecutionWorker","jid":"456da12c7ba46e2d00197fcc","created_at":"2026-10-21T22:13:12.048Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-bb21039da7584e98","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aea45c7eb20bf4947794afa96c9152656ad98d8abd028c02fd5789b914aa71b1","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:12.054Z","job_size_bytes":2593,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-456da12c7ba46e2d00197fcc: start","job_status":"start","queue_duration_s":1.234194,"scheduling_latency_s":1.23421}1926gitlab # [ 264.030046] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.329Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","326d96487116ae01ca6dd5b8"],"class":"WebHooks::LogExecutionWorker","jid":"456da12c7ba46e2d00197fcc","created_at":"2026-10-21T22:13:12.048Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-bb21039da7584e98","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aea45c7eb20bf4947794afa96c9152656ad98d8abd028c02fd5789b914aa71b1","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:12.054Z","job_size_bytes":2593,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-456da12c7ba46e2d00197fcc: done: 0.04031 sec","job_status":"done","queue_duration_s":1.234194,"scheduling_latency_s":1.23421,"redis_calls":10,"redis_duration_s":0.0068059999999999996,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000867,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005632,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000307,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000269587,"duration_s":0.04031,"completed_at":"2026-10-21T22:13:13.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007141,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1927gitlab # [ 264.078778] gitaly[915]: time="2026-10-21T22:13:13.207Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3AAXDMC9VWGD8V7YGG8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.200" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928gitlab # [ 264.079439] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 471929gitlab # [ 264.080307] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 641930gitlab # [ 264.080781] gitlab-workhorse[825]: time="2026-10-21T22:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671931gitlab # [ 264.081323] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 731932gitlab # [ 264.081918] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.330Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"594344d8a9033e36593138ae","created_at":"2026-10-21T22:13:12.758Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-5efab767411b4516","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:12.763Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-594344d8a9033e36593138ae: start","job_status":"start","queue_duration_s":0.56714,"scheduling_latency_s":0.567157}1933gitlab # [ 264.092341] gitaly[915]: time="2026-10-21T22:13:13.208Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3AAXDMC9VWGD8V7YGG8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.200" grpc.time_ms=7.481 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1934gitlab # [ 264.139729] gitlab-workhorse[825]: time="2026-10-21T22:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2211935gitlab # [ 264.140635] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 221 "" "git/2.55.0" 741936gitlab # [ 264.141122] gitaly[915]: time="2026-10-21T22:13:13.296Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3CEZ04XT5M40197T0DJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.287" grpc.time_ms=9.305 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1937gitlab # [ 264.141892] gitaly[915]: time="2026-10-21T22:13:13.349Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3EJG66ES2MMJCJS5WVS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.339" pid=915 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1938gitlab # [ 264.142626] gitaly[915]: time="2026-10-21T22:13:13.349Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3EJG66ES2MMJCJS5WVS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.339" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1939gitlab # [ 264.145660] gitaly[915]: time="2026-10-21T22:13:13.349Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3EJG66ES2MMJCJS5WVS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.339" grpc.time_ms=10.38 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1940gitlab # [ 264.193577] gitaly[915]: time="2026-10-21T22:13:13.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3H35CBY82QWNZZTHDQ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.419" grpc.time_ms=6.965 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1941gitlab # [ 264.194475] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 711942gitlab # [ 264.195135] gitaly[915]: time="2026-10-21T22:13:13.447Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3H6V30Z1YWD7EG8K9X7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.439" grpc.time_ms=7.585 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1943gitlab # [ 264.195370] gitaly[915]: time="2026-10-21T22:13:13.460Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:13.459" grpc.time_ms=0.391 pid=915 span.kind=server system=grpc1944gitlab # [ 264.196618] gitaly[915]: time="2026-10-21T22:13:13.487Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:13.486" grpc.time_ms=0.278 pid=915 span.kind=server system=grpc1945gitlab # [ 264.205790] gitaly[915]: time="2026-10-21T22:13:13.501Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3JM8V5CJEVQPZ6JAXV2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.488" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1946gitlab # [ 264.255972] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.628Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"594344d8a9033e36593138ae","created_at":"2026-10-21T22:13:12.758Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-5efab767411b4516","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:12.763Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2565,"job_status":"rescheduled","message":"PipelineProcessWorker JID-594344d8a9033e36593138ae: rescheduled"}1947gitlab # [ 264.256766] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.636Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"594344d8a9033e36593138ae","created_at":"2026-10-21T22:13:12.758Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-5efab767411b4516","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:12.763Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-594344d8a9033e36593138ae: done: 0.305622 sec","job_status":"done","queue_duration_s":0.56714,"scheduling_latency_s":0.567157,"gitaly_calls":3,"gitaly_duration_s":0.11772,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.030161,"redis_read_bytes":148,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.003441,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000651,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.007302,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.008342,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000833,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00405,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.039,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.039,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093931,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.271258218,"duration_s":0.305622,"completed_at":"2026-10-21T22:13:13.636Z","load_balancing_strategy":"primary","db_duration_s":0.06754,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1948gitlab # [ 264.318879] gitlab-workhorse[825]: time="2026-10-21T22:13:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161949gitlab # [ 264.319686] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 591950gitlab # [ 264.320194] gitaly[915]: time="2026-10-21T22:13:13.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3JM8V5CJEVQPZ6JAXV2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.488" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1951gitlab # [ 264.320377] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.638Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b3b72bef3ff8d66e8caf0cec"],"class":"WebHooks::LogExecutionWorker","jid":"b05c410e9d51d33ff8da7938","created_at":"2026-10-21T22:13:13.228Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-668e1d4f76464287","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c74332472fcbbe36f9050aca96fc26d9581942d8a8a17eb00bb317de9edb2c23","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.231Z","job_size_bytes":2591,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b05c410e9d51d33ff8da7938: start","job_status":"start","queue_duration_s":0.407656,"scheduling_latency_s":0.407677}1952gitlab # [ 264.321053] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.662Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","b3b72bef3ff8d66e8caf0cec"],"class":"WebHooks::LogExecutionWorker","jid":"b05c410e9d51d33ff8da7938","created_at":"2026-10-21T22:13:13.228Z","trace_propagation_headers":{"sentry-trace":"7b958b5c97734ab7ada1a9319818f05f-668e1d4f76464287","baggage":"sentry-trace_id=7b958b5c97734ab7ada1a9319818f05f,sentry-release=Unknown"},"correlation_id":"01M5G8CYFEPBYWBCY09P9Y6JFY","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c74332472fcbbe36f9050aca96fc26d9581942d8a8a17eb00bb317de9edb2c23","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.231Z","job_size_bytes":2591,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b05c410e9d51d33ff8da7938: done: 0.02382 sec","job_status":"done","queue_duration_s":0.407656,"scheduling_latency_s":0.407677,"redis_calls":7,"redis_duration_s":0.003635,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003092,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02382,"completed_at":"2026-10-21T22:13:13.662Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1953gitlab # [ 264.373816] gitaly[915]: time="2026-10-21T22:13:13.501Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3JM8V5CJEVQPZ6JAXV2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.488" grpc.time_ms=13.054 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1954gitlab # [ 264.374626] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"92969d054692c48b9067b1d7","created_at":"2026-10-21T22:13:13.276Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-475676fa444b4f3d","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.281Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-92969d054692c48b9067b1d7: start","job_status":"start","queue_duration_s":0.382682,"scheduling_latency_s":0.382703}1955gitlab # [ 264.422170] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.733Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"92969d054692c48b9067b1d7","created_at":"2026-10-21T22:13:13.276Z","trace_propagation_headers":{"sentry-trace":"490d4561f6fe48ab8e49b76a7674c218-475676fa444b4f3d","baggage":"sentry-trace_id=490d4561f6fe48ab8e49b76a7674c218,sentry-release=Unknown"},"correlation_id":"01M5G8B7BYPSM67WKVRG5PD0BZ","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.281Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-92969d054692c48b9067b1d7: done: 0.070118 sec","job_status":"done","queue_duration_s":0.382682,"scheduling_latency_s":0.382703,"redis_calls":11,"redis_duration_s":0.0020499999999999997,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000325,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000577,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000257295,"duration_s":0.070118,"completed_at":"2026-10-21T22:13:13.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018018,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 264.471474] gitaly[915]: time="2026-10-21T22:13:13.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:13.516" grpc.time_ms=0.347 pid=915 span.kind=server system=grpc1957gitlab # [ 264.472115] gitaly[915]: time="2026-10-21T22:13:13.523Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3K9E0S1HNWGMDTVACQS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.497" pid=915 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=221 span.kind=server system=grpc1958gitlab # [ 264.472804] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.735Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7256d105b3db11e32108c9b0","created_at":"2026-10-21T22:13:13.420Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.422Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7256d105b3db11e32108c9b0: start","job_status":"start","queue_duration_s":0.312626,"scheduling_latency_s":0.312644}1959gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6'1960gitlab # [ 264.473523] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.772Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"7256d105b3db11e32108c9b0","created_at":"2026-10-21T22:13:13.420Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.422Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-7256d105b3db11e32108c9b0: done: 0.037703 sec","job_status":"done","queue_duration_s":0.312626,"scheduling_latency_s":0.312644,"redis_calls":7,"redis_duration_s":0.001161,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000869,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037703,"completed_at":"2026-10-21T22:13:13.772Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007784,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1961gitlab # [ 264.522032] gitaly[915]: time="2026-10-21T22:13:13.523Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3K9E0S1HNWGMDTVACQS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.497" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1962gitlab # [ 264.522752] nixbot[2690]: {"ts": "2026-10-21T22:13:13.940Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-448621d6100f-6"}1963gitlab # [ 264.524621] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.773Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea1e9d70c70bf19a1236c553","created_at":"2026-10-21T22:13:13.540Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.542Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea1e9d70c70bf19a1236c553: start","job_status":"start","queue_duration_s":0.230934,"scheduling_latency_s":0.230952}1964gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6', in 0.04 seconds)1965(finished: subtest: push delivers the webhook, in 55.70 seconds)1966subtest: eval and build post commit statuses1967gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses1968gitlab # [ 264.537592] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.796Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ea1e9d70c70bf19a1236c553","created_at":"2026-10-21T22:13:13.540Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.542Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ea1e9d70c70bf19a1236c553: done: 0.022831 sec","job_status":"done","queue_duration_s":0.230934,"scheduling_latency_s":0.230952,"redis_calls":7,"redis_duration_s":0.001645,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015967,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022831,"completed_at":"2026-10-21T22:13:13.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003253,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1969gitlab # [ 264.579930] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2371970gitlab # [ 264.580696] gitaly[915]: time="2026-10-21T22:13:13.523Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1162 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3K9E0S1HNWGMDTVACQS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.497" grpc.time_ms=26.187 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1971gitlab # [ 264.629477] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"eb1b4660ea97f2a303d8e3a6","created_at":"2026-10-21T22:13:13.550Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.552Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-eb1b4660ea97f2a303d8e3a6: start","job_status":"start","queue_duration_s":0.245947,"scheduling_latency_s":0.245974}1972gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses, in 0.09 seconds)1973gitlab # [ 264.630248] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.821Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"eb1b4660ea97f2a303d8e3a6","created_at":"2026-10-21T22:13:13.550Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.552Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-eb1b4660ea97f2a303d8e3a6: done: 0.023247 sec","job_status":"done","queue_duration_s":0.245947,"scheduling_latency_s":0.245974,"redis_calls":7,"redis_duration_s":0.001269,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023247,"completed_at":"2026-10-21T22:13:13.821Z","load_balancing_strategy":"primary","db_duration_s":0.003775,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1974gitlab # [ 264.685557] nixbot[2690]: {"ts": "2026-10-21T22:13:14.020Z", "level": "info", "logger": "uvicorn.access", "msg": "::ffff:127.0.0.1:47894 - \"GET /api/repos/gitlab/root/test-flake/builds?commit=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1\" 200"}1975gitlab # [ 264.686225] nixbot[2690]: {"ts": "2026-10-21T22:13:14.047Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-448621d6100f-6", "argv0": "bwrap"}1976gitlab # [ 264.686827] gitaly[915]: time="2026-10-21T22:13:13.535Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR diskcache=741c91ad-6a7f-476d-b248-a358171b4260 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:43.328" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:13.428" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1977gitlab # [ 264.687490] gitaly[915]: time="2026-10-21T22:13:13.535Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=76 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7264 command.oublock=0 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=49 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:43.328" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:13.428" grpc.time_ms=107.082 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1978gitlab # [ 264.688154] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"048ba32511746f76accf2129","created_at":"2026-10-21T22:13:13.561Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.564Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-048ba32511746f76accf2129: start","job_status":"start","queue_duration_s":0.25844,"scheduling_latency_s":0.25846}1979gitlab # [ 264.688791] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"048ba32511746f76accf2129","created_at":"2026-10-21T22:13:13.561Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.564Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-048ba32511746f76accf2129: done: 0.022448 sec","job_status":"done","queue_duration_s":0.25844,"scheduling_latency_s":0.25846,"redis_calls":10,"redis_duration_s":0.001652,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000466,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022448,"completed_at":"2026-10-21T22:13:13.844Z","load_balancing_strategy":"primary","db_duration_s":0.004175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1980gitlab # [ 264.743419] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 631981gitlab # [ 264.743980] gitaly[915]: time="2026-10-21T22:13:13.592Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=2 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-21T22:13:43.488" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:13.589" grpc.time_ms=3.861 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982gitlab # [ 264.744688] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.846Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"055dd0a39ad50e54e1d2f958","created_at":"2026-10-21T22:13:13.564Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.565Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-055dd0a39ad50e54e1d2f958: start","job_status":"start","queue_duration_s":0.280086,"scheduling_latency_s":0.280102}1983gitlab # [ 264.796058] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"055dd0a39ad50e54e1d2f958","created_at":"2026-10-21T22:13:13.564Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.565Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-055dd0a39ad50e54e1d2f958: done: 0.022736 sec","job_status":"done","queue_duration_s":0.280086,"scheduling_latency_s":0.280102,"redis_calls":7,"redis_duration_s":0.0014449999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000338,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022736,"completed_at":"2026-10-21T22:13:13.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1984gitlab # [ 264.797112] gitaly[915]: time="2026-10-21T22:13:13.606Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3P0RZ5W92JG5ZKAS4Z1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.590" grpc.time_ms=16.442 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1985gitlab # [ 264.836108] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"04859948a5d0c8c248d15c67","created_at":"2026-10-21T22:13:13.566Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.568Z","job_size_bytes":19,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-04859948a5d0c8c248d15c67: start","job_status":"start","queue_duration_s":0.304131,"scheduling_latency_s":0.304157}1986gitlab # [ 264.836817] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.891Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"04859948a5d0c8c248d15c67","created_at":"2026-10-21T22:13:13.566Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.568Z","job_size_bytes":19,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-04859948a5d0c8c248d15c67: done: 0.019017 sec","job_status":"done","queue_duration_s":0.304131,"scheduling_latency_s":0.304157,"redis_calls":8,"redis_duration_s":0.001466,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019017,"completed_at":"2026-10-21T22:13:13.891Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 264.878055] gitaly[915]: time="2026-10-21T22:13:13.619Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D2QHJEAKDV0Z0ASYH9ZR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:43.518" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:13.618" grpc.time_ms=0.481 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988gitlab # [ 264.878474] gitaly[915]: time="2026-10-21T22:13:13.667Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3R9P5KY2GJGCK9VRDAB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.656" pid=915 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1989gitlab # [ 264.880533] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.892Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0ee5dc344749f53c6568b31f","created_at":"2026-10-21T22:13:13.569Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.570Z","job_size_bytes":66,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0ee5dc344749f53c6568b31f: start","job_status":"start","queue_duration_s":0.321514,"scheduling_latency_s":0.321532}1990gitlab # [ 264.926728] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.911Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"0ee5dc344749f53c6568b31f","created_at":"2026-10-21T22:13:13.569Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.570Z","job_size_bytes":66,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-0ee5dc344749f53c6568b31f: done: 0.019508 sec","job_status":"done","queue_duration_s":0.321514,"scheduling_latency_s":0.321532,"redis_calls":7,"redis_duration_s":0.002398,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019508,"completed_at":"2026-10-21T22:13:13.911Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002808,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 264.934794] gitaly[915]: time="2026-10-21T22:13:13.667Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3R9P5KY2GJGCK9VRDAB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.656" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1992gitlab # [ 264.947506] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.913Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1e05d0b22203583e7fd6ec78","created_at":"2026-10-21T22:13:13.571Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.572Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1e05d0b22203583e7fd6ec78: start","job_status":"start","queue_duration_s":0.34069,"scheduling_latency_s":0.340708}1993gitlab # [ 264.999807] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.931Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"1e05d0b22203583e7fd6ec78","created_at":"2026-10-21T22:13:13.571Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.572Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1e05d0b22203583e7fd6ec78: done: 0.018687 sec","job_status":"done","queue_duration_s":0.34069,"scheduling_latency_s":0.340708,"redis_calls":7,"redis_duration_s":0.001111,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018687,"completed_at":"2026-10-21T22:13:13.931Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003305,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1994gitlab # [ 265.000989] gitaly[915]: time="2026-10-21T22:13:13.668Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3R9P5KY2GJGCK9VRDAB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-10-21T22:13:13.656" grpc.time_ms=11.938 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1995gitlab # [ 265.052130] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.933Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5bec3c62066e6ee0d852edab","created_at":"2026-10-21T22:13:13.575Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.576Z","job_size_bytes":6,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5bec3c62066e6ee0d852edab: start","job_status":"start","queue_duration_s":0.356287,"scheduling_latency_s":0.356304}1996gitlab # [ 265.053071] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.943Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5bec3c62066e6ee0d852edab","created_at":"2026-10-21T22:13:13.575Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.576Z","job_size_bytes":6,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5bec3c62066e6ee0d852edab: done: 0.010456 sec","job_status":"done","queue_duration_s":0.356287,"scheduling_latency_s":0.356304,"redis_calls":7,"redis_duration_s":0.001178,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010456,"completed_at":"2026-10-21T22:13:13.943Z","load_balancing_strategy":"primary","db_duration_s":0.000458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 265.066975] gitaly[915]: time="2026-10-21T22:13:13.740Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:43.139" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:13.739" grpc.time_ms=0.66 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1998gitlab # [ 265.079120] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.944Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d086cf25d7afc653df25816b","created_at":"2026-10-21T22:13:13.577Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.578Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d086cf25d7afc653df25816b: start","job_status":"start","queue_duration_s":0.366252,"scheduling_latency_s":0.366264}1999gitlab # [ 265.093500] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.960Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"d086cf25d7afc653df25816b","created_at":"2026-10-21T22:13:13.577Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.578Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d086cf25d7afc653df25816b: done: 0.015705 sec","job_status":"done","queue_duration_s":0.366252,"scheduling_latency_s":0.366264,"redis_calls":7,"redis_duration_s":0.001067,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015705,"completed_at":"2026-10-21T22:13:13.960Z","load_balancing_strategy":"primary","db_duration_s":0.002418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2000gitlab # [ 265.166878] gitaly[915]: time="2026-10-21T22:13:13.754Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=649 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-10-21T22:13:43.146" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:13.747" grpc.time_ms=6.561 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2001gitlab # [ 265.167647] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.961Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4fc583485ea416c52a5999ad","created_at":"2026-10-21T22:13:13.628Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.630Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4fc583485ea416c52a5999ad: start","job_status":"start","queue_duration_s":0.331517,"scheduling_latency_s":0.331537}2002gitlab # [ 265.168227] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.981Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4fc583485ea416c52a5999ad","created_at":"2026-10-21T22:13:13.628Z","trace_propagation_headers":{"sentry-trace":"669092a1a9db49e0ab5c3121fa9dedcc-220c22d444194c28","baggage":"sentry-trace_id=669092a1a9db49e0ab5c3121fa9dedcc,sentry-release=Unknown"},"correlation_id":"01M5G8D2QHJEAKDV0Z0ASYH9ZR","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.630Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4fc583485ea416c52a5999ad: done: 0.019554 sec","job_status":"done","queue_duration_s":0.331517,"scheduling_latency_s":0.331537,"redis_calls":8,"redis_duration_s":0.001441,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019554,"completed_at":"2026-10-21T22:13:13.981Z","load_balancing_strategy":"primary","db_duration_s":0.003104,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2003gitlab # [ 265.232843] gitaly[915]: time="2026-10-21T22:13:13.766Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:23.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:13.759" grpc.time_ms=6.838 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2004gitlab # [ 265.233739] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:13.982Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"db91f4d1f54db986db911d92","created_at":"2026-10-21T22:13:13.874Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-1e5a609a29fd4277","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.876Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-db91f4d1f54db986db911d92: start","job_status":"start","queue_duration_s":0.105245,"scheduling_latency_s":0.105263}2005gitlab # [ 265.234601] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.003Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"db91f4d1f54db986db911d92","created_at":"2026-10-21T22:13:13.874Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-1e5a609a29fd4277","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.876Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-db91f4d1f54db986db911d92: done: 0.021196 sec","job_status":"done","queue_duration_s":0.105245,"scheduling_latency_s":0.105263,"redis_calls":7,"redis_duration_s":0.001241,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021196,"completed_at":"2026-10-21T22:13:14.003Z","load_balancing_strategy":"primary","db_duration_s":0.004719,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2006gitlab # [ 265.285873] gitaly[915]: time="2026-10-21T22:13:13.789Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-10-21T22:13:23.048" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:13.789" grpc.time_ms=0.211 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007gitlab # [ 265.286692] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.004Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b34628a0a91fd988bf38f5db","created_at":"2026-10-21T22:13:13.877Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-1e5a609a29fd4277","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.879Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b34628a0a91fd988bf38f5db: start","job_status":"start","queue_duration_s":0.125097,"scheduling_latency_s":0.125113}2008gitlab # [ 265.287662] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.047Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b34628a0a91fd988bf38f5db","created_at":"2026-10-21T22:13:13.877Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-1e5a609a29fd4277","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.879Z","job_size_bytes":65,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b34628a0a91fd988bf38f5db: done: 0.042998 sec","job_status":"done","queue_duration_s":0.125097,"scheduling_latency_s":0.125113,"redis_calls":10,"redis_duration_s":0.002437,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042998,"completed_at":"2026-10-21T22:13:14.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2009gitlab # [ 265.330818] gitaly[915]: time="2026-10-21T22:13:13.799Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=617 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-10-21T22:13:23.053" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:13.793" grpc.time_ms=5.696 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 265.338601] gitaly[915]: time="2026-10-21T22:13:13.831Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4149 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:13.830" grpc.time_ms=0.574 pid=915 span.kind=server system=grpc2011gitlab # [ 265.347663] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.048Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"90681158a212fa627758347e","created_at":"2026-10-21T22:13:13.920Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-1e5a609a29fd4277","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.923Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-90681158a212fa627758347e: start","job_status":"start","queue_duration_s":0.125664,"scheduling_latency_s":0.125685}2012gitlab # [ 265.391886] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.144Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"90681158a212fa627758347e","created_at":"2026-10-21T22:13:13.920Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-1e5a609a29fd4277","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:13.923Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-90681158a212fa627758347e: done: 0.095714 sec","job_status":"done","queue_duration_s":0.125664,"scheduling_latency_s":0.125685,"gitaly_calls":2,"gitaly_duration_s":0.005623,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.005466,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000836,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000771,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000202,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00021,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000311,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067693,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.071078307,"duration_s":0.095714,"completed_at":"2026-10-21T22:13:14.144Z","load_balancing_strategy":"primary","db_duration_s":0.01857,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2013gitlab # [ 265.408631] gitaly[915]: time="2026-10-21T22:13:13.854Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4151 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:13.854" grpc.time_ms=0.331 pid=915 span.kind=server system=grpc2014gitlab # [ 265.417468] gitaly[915]: time="2026-10-21T22:13:13.864Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M diskcache=47e5063e-386e-4b29-ba55-3d8a4e0439b9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-21T22:13:23.061" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:13.801" pid=915 ref=refs/keep-around/448621d6100f54bfb6e7a655e2553a1ccde7a1a6 remote_ip="2001:db8:1::1" revision=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 span.kind=server system=grpc username=root2015gitlab # [ 265.428170] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.145Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"43bf8d424f6c2161ae59df70","created_at":"2026-10-21T22:13:14.097Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-b69fea114a2a425f","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:14.098Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-43bf8d424f6c2161ae59df70: start","job_status":"start","queue_duration_s":0.046955,"scheduling_latency_s":0.046974}2016gitlab # [ 265.442921] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:14.168Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"43bf8d424f6c2161ae59df70","created_at":"2026-10-21T22:13:14.097Z","trace_propagation_headers":{"sentry-trace":"b3019460ec23479ab34d979490a00888-b69fea114a2a425f","baggage":"sentry-trace_id=b3019460ec23479ab34d979490a00888,sentry-release=Unknown"},"correlation_id":"01M5G8D3V03BRCH9JA5G39D13M","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:14.098Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-43bf8d424f6c2161ae59df70: done: 0.02296 sec","job_status":"done","queue_duration_s":0.046955,"scheduling_latency_s":0.046974,"redis_calls":7,"redis_duration_s":0.0010170000000000001,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02296,"completed_at":"2026-10-21T22:13:14.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2017gitlab # [ 265.484553] gitaly[915]: time="2026-10-21T22:13:13.864Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=51 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5246 command.oublock=8 command.real_time_ms=55 command.spawn_token_fork_ms=2 command.system_time_ms=30 command.user_time_ms=21 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-10-21T22:13:23.061" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-10-21T22:13:13.801" grpc.time_ms=62.992 pid=915 ref=refs/keep-around/448621d6100f54bfb6e7a655e2553a1ccde7a1a6 remote_ip="2001:db8:1::1" revision=448621d6100f54bfb6e7a655e2553a1ccde7a1a6 span.kind=server system=grpc username=root2018gitlab # [ 265.524932] gitaly[915]: time="2026-10-21T22:13:13.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:43.268" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:13.868" grpc.time_ms=0.326 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019gitlab # [ 265.525700] gitaly[915]: time="2026-10-21T22:13:14.084Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D45W77QW9109WS0083EV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:44.082" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:14.083" grpc.time_ms=0.709 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020gitlab # [ 265.526520] gitaly[915]: time="2026-10-21T22:13:14.108Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-21T22:13:44.007" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:14.108" grpc.time_ms=0.701 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 265.527925] gitaly[915]: time="2026-10-21T22:13:14.136Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D3V03BRCH9JA5G39D13M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:44.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:14.135" grpc.time_ms=0.558 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 265.633638] nix-daemon[2865]: accepted connection from pid 3780, user nixbot2023gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses2024gitlab # [ 265.782585] gitaly[915]: time="2026-10-21T22:13:15.214Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D58V1JT0WGBXN32KKRJF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:45.113" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:15.213" grpc.time_ms=0.716 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025gitlab # [ 265.834468] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1022026gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses, in 0.16 seconds)2027gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses2028gitlab # [ 266.928184] gitaly[915]: time="2026-10-21T22:13:16.359Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D6CKPB203RPC6CW49CKE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:46.257" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:16.358" grpc.time_ms=0.828 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2029gitlab # [ 266.971927] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 952030gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses, in 0.13 seconds)2031gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses2032gitlab # [ 268.066303] gitaly[915]: time="2026-10-21T22:13:17.497Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D7G2MK6MK11VPF96Q4MB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:47.396" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:17.496" grpc.time_ms=0.916 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2033gitlab # [ 268.089552] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 782034gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses, in 0.12 seconds)2035gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses2036gitlab # [ 269.204181] gitaly[915]: time="2026-10-21T22:13:18.635Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D8K6557EEWCZ91NCXPX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:48.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:18.634" grpc.time_ms=0.848 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2037gitlab # [ 269.247705] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1122038gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses, in 0.15 seconds)2039gitlab # [ 269.729591] nix-daemon[2865]: accepted connection from pid 3816, user nixbot2040gitlab # [ 269.740216] nix-daemon[2865]: accepted connection from pid 3780, user nixbot2041gitlab # [ 269.836571] gitaly[915]: time="2026-10-21T22:13:19.268Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:49.167" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:19.267" grpc.time_ms=0.786 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 269.887603] gitaly[915]: time="2026-10-21T22:13:19.319Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:29.199" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.310" grpc.time_ms=9.401 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2043gitlab # [ 269.950217] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.381Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8f9cc9ae743b387c8e25f25a","created_at":"2026-10-21T22:13:19.373Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-d86e57437459483e","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:19.378Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8f9cc9ae743b387c8e25f25a: start","job_status":"start","queue_duration_s":0.002559,"scheduling_latency_s":0.002607}2044gitlab # [ 269.990569] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2122045gitlab # [ 270.035363] gitaly[915]: time="2026-10-21T22:13:19.467Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D9E5D80SAG95AGKB2JNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:49.366" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:19.466" grpc.time_ms=0.662 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046gitlab # [ 270.070287] gitaly[915]: time="2026-10-21T22:13:19.502Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:19.502" grpc.time_ms=0.326 pid=915 span.kind=server system=grpc2047gitlab # [ 270.083530] gitaly[915]: time="2026-10-21T22:13:19.515Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D9E5D80SAG95AGKB2JNW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:29.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.498" grpc.time_ms=17.504 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 270.115651] gitaly[915]: time="2026-10-21T22:13:19.547Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3891 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:19.547" grpc.time_ms=0.538 pid=915 span.kind=server system=grpc2049gitlab # [ 270.129838] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1322050gitlab # [ 270.150057] gitaly[915]: time="2026-10-21T22:13:19.582Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3893 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-10-21T22:13:19.581" grpc.time_ms=0.343 pid=915 span.kind=server system=grpc2051gitlab # [ 270.161646] gitaly[915]: time="2026-10-21T22:13:19.594Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:49.367" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.467" operations="[repack_refs]" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 270.171937] gitaly[915]: time="2026-10-21T22:13:19.595Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:49.367" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.467" pid=915 remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-10-21 22:12:03.90465895 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2053gitlab # [ 270.172247] gitaly[915]: time="2026-10-21T22:13:19.599Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 diskcache=9802b215-dcc6-4cc9-8fd5-1e89bf5d58c0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:49.367" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.467" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2054gitlab # [ 270.173665] gitaly[915]: time="2026-10-21T22:13:19.599Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=108 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7693 command.oublock=0 command.real_time_ms=124 command.spawn_token_fork_ms=0 command.system_time_ms=67 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:49.367" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.467" grpc.time_ms=131.434 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055gitlab # [ 270.179389] gitaly[915]: time="2026-10-21T22:13:19.611Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:49.367" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.467" pid=915 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2056gitlab # [ 270.180213] gitaly[915]: time="2026-10-21T22:13:19.612Z" level=info msg="optimized repository" clean_stale_data_time=15.678808ms clean_work_trees_time="76.267µs" commit_graph_time="4.19µs" correlation_id=01M5G8D97A51BMW76H3XYG0WP6 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="3.911µs" pid=915 prune_time="3.911µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="5.029µs" storage_name=default system=housekeeping total_time=15.880231ms2057gitlab # [ 270.181195] gitaly[915]: time="2026-10-21T22:13:19.612Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-10-21T22:13:49.367" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.467" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 270.233875] gitaly[915]: time="2026-10-21T22:13:19.665Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D9JRP30VJC4J41BC4CSC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:49.564" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:19.665" grpc.time_ms=0.596 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses2060gitlab # [ 270.271397] gitaly[915]: time="2026-10-21T22:13:19.703Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D9JRP30VJC4J41BC4CSC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-10-21T22:13:29.202" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-10-21T22:13:19.693" grpc.time_ms=10.278 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 270.290407] gitaly[915]: time="2026-10-21T22:13:19.722Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-10-21T22:13:49.621" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:19.722" grpc.time_ms=0.678 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 270.317213] gitaly[915]: time="2026-10-21T22:13:19.749Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D97A51BMW76H3XYG0WP6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:49.648" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:19.748" grpc.time_ms=0.624 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 270.319073] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/448621d6100f54bfb6e7a655e2553a1ccde7a1a6 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1742064gitlab # [ 270.327919] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.760Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8ecd18b673aa005df64bf05a","created_at":"2026-10-21T22:13:19.758Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-551388bd24824a38","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"8f9cc9ae743b387c8e25f25a","job_size_bytes":3,"pid":2565,"job_status":"deduplicated","message":"PipelineProcessWorker JID-8ecd18b673aa005df64bf05a: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2065gitlab # [ 270.330720] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.762Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8f9cc9ae743b387c8e25f25a","created_at":"2026-10-21T22:13:19.373Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-d86e57437459483e","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:19.378Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2565,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8f9cc9ae743b387c8e25f25a: rescheduled"}2066gitlab # [ 270.334313] gitaly[915]: time="2026-10-21T22:13:19.766Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M5G8D9Q63PR9RXQWF6PZSN1A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-10-21T22:13:49.162" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-10-21T22:13:19.762" grpc.time_ms=3.465 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses, in 0.15 seconds)2068(finished: subtest: eval and build post commit statuses, in 5.81 seconds)2069(finished: run the VM test script, in 337.70 seconds)2070gitlab # [ 270.336393] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.768Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8f9cc9ae743b387c8e25f25a","created_at":"2026-10-21T22:13:19.373Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-d86e57437459483e","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:19.378Z","job_size_bytes":3,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8f9cc9ae743b387c8e25f25a: done: 0.387749 sec","job_status":"done","queue_duration_s":0.002559,"scheduling_latency_s":0.002607,"gitaly_calls":3,"gitaly_duration_s":0.14013,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.087439,"redis_read_bytes":239,"redis_write_bytes":21781,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00112,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00307,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.004167,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.063751,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000329,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000674,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.013208,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121417,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.343962431,"duration_s":0.387749,"completed_at":"2026-10-21T22:13:19.768Z","load_balancing_strategy":"primary","db_duration_s":0.041476,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2071gitlab # [ 270.383833] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.774Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"10a31702aaf48cbf7d987041","created_at":"2026-10-21T22:13:19.456Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-551388bd24824a38","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:19.459Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-10a31702aaf48cbf7d987041: start","job_status":"start","queue_duration_s":0.31485,"scheduling_latency_s":0.314871}2072gitlab # [ 270.393131] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/10/21:22:13:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/448621d6100f54bfb6e7a655e2553a1ccde7a1a6/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 662073gitlab # [ 270.405581] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.837Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"10a31702aaf48cbf7d987041","created_at":"2026-10-21T22:13:19.456Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-551388bd24824a38","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-10-21T22:13:19.459Z","job_size_bytes":23,"pid":2565,"sidekiq_tid":"m829","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-10a31702aaf48cbf7d987041: done: 0.06304 sec","job_status":"done","queue_duration_s":0.31485,"scheduling_latency_s":0.314871,"redis_calls":7,"redis_duration_s":0.024171,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.022523,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001648,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06304,"completed_at":"2026-10-21T22:13:19.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013129,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2074test script finished in 337.78s2075cleanup2076kill QemuMachine (pid 46)2077gitlab # [ 270.479256] sidekiq-cluster[2565]: {"severity":"INFO","time":"2026-10-21T22:13:19.844Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"481c7439dfcfce6513f5e78c","created_at":"2026-10-21T22:13:19.603Z","trace_propagation_headers":{"sentry-trace":"f8821814734d4479ae9af0dd2d20d480-551388bd24824a38","baggage":"sentry-trace_id=f8821814734d4479ae9af0dd2d20d480,sentry-release=Unknown"},"correlation_id":"01M5G8D97A51BMW76H3XYG0WP6","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consisteqemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2078gitlab # n2079(finished: cleanup, in 1.59 seconds)2080additionally exposed symbols:2081 gitlab,2082 vlan1,2083 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2084[]2085[]2086[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-10-21T22:12:18.197Z', 'push_events': True, 'tag_push_events': True, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2087[]2088[]2089[]2090[]2091[]2092[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-10-21T22:13:13.689278Z', 'started_at': '2026-10-21T22:13:13.938086Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2093[{'id': 5, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-21T22:13:13.915Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2094[{'id': 5, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-21T22:13:13.915Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2095[{'id': 5, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-21T22:13:13.915Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2096[{'id': 5, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-21T22:13:13.915Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2097[{'id': 5, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-10-21T22:13:13.915Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2098[{'id': 5, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 5s (1 warning)', 'created_at': '2026-10-21T22:13:13.915Z', 'started_at': None, 'finished_at': '2026-10-21T22:13:19.362Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '448621d6100f54bfb6e7a655e2553a1ccde7a1a6', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-10-21T22:13:19.544Z', 'started_at': None, 'finished_at': '2026-10-21T22:13:19.721Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]