vm-test-run-nixbot-gitlab
checks.x86_64-linux.nixbot-gitlab
· build #384
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.NqNCMXAouO', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 49.64 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: 5ed49a1c-9007-467a-9fda-ac0d8e9562bc19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)31gitlab # 32gitlab # 33gitlab # iPXE (http://ipxe.org) 00:03.0 CA00 PCI2.10 PnP PMM+BEFD1900+BEF31900 CA0034gitlab # Press Ctrl-B to configure iPXE (PCI 00:03.0)...35gitlab # 36gitlab # 37gitlab # 38gitlab # 39gitlab # iPXE (http://ipxe.org) 00:09.0 CB00 PCI2.10 PnP PMM BEFD1900 BEF31900 CB0040gitlab # Press Ctrl-B to configure iPXE (PCI 00:09.0)...41gitlab # 42gitlab # 43gitlab # Booting from ROM...44gitlab # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Thu Aug 6 17:27:09 UTC 202645gitlab # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s1kqp7fpf3izg59nbs23h0r0fqspmvjk-nixos-system-gitlab-test/init regInfo=/nix/store/j2s6lqghs4rf6si3djzbvdjaciak0rzs-closure-info/registration console=ttyS0,115200n8 console=tty046gitlab # [ 0.000000] BIOS-provided physical RAM map:47gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable48gitlab # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved49gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved50gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffd7fff] usable51gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000bffd8000-0x00000000bfffffff] reserved52gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved53gitlab # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved54gitlab # [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x00000001bfffffff] usable55gitlab # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved56gitlab # [ 0.000000] NX (Execute Disable) protection: active57gitlab # [ 0.000000] APIC: Static calls initialized58gitlab # [ 0.000000] SMBIOS 2.8 present.59gitlab # [ 0.000000] DMI: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/201460gitlab # [ 0.000000] DMI: Memory slots populated: 1/161gitlab # [ 0.000000] Hypervisor detected: KVM62gitlab # [ 0.000000] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000063gitlab # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d0064gitlab # [ 0.000000] kvm-clock: using sched offset of 474418990 cycles65gitlab # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns66gitlab # [ 0.000005] tsc: Detected 2400.012 MHz processor67gitlab # [ 0.000808] last_pfn = 0x1c0000 max_arch_pfn = 0x1000000000068gitlab # [ 0.000836] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs69gitlab # [ 0.000838] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT70gitlab # [ 0.000877] last_pfn = 0xbffd8 max_arch_pfn = 0x1000000000071gitlab # [ 0.002744] found SMP MP-table at [mem 0x000f5470-0x000f547f]72gitlab # [ 0.002755] Using GB pages for direct mapping73gitlab # [ 0.002818] RAMDISK: [mem 0xbe31c000-0xbffcffff]74gitlab # [ 0.002827] ACPI: Early table checksum verification disabled75gitlab # [ 0.002829] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )76gitlab # [ 0.002833] ACPI: RSDT 0x00000000BFFE24E3 000034 (v01 BOCHS BXPC 00000001 BXPC 00000001)77gitlab # [ 0.002837] ACPI: FACP 0x00000000BFFE237F 000074 (v01 BOCHS BXPC 00000001 BXPC 00000001)78gitlab # [ 0.002844] ACPI: DSDT 0x00000000BFFE0040 00233F (v01 BOCHS BXPC 00000001 BXPC 00000001)79gitlab # [ 0.002846] ACPI: FACS 0x00000000BFFE0000 00004080gitlab # [ 0.002848] ACPI: APIC 0x00000000BFFE23F3 000090 (v03 BOCHS BXPC 00000001 BXPC 00000001)81gitlab # [ 0.002850] ACPI: HPET 0x00000000BFFE2483 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)82gitlab # [ 0.002851] ACPI: WAET 0x00000000BFFE24BB 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)83gitlab # [ 0.002852] ACPI: Reserving FACP table memory at [mem 0xbffe237f-0xbffe23f2]84gitlab # [ 0.002854] ACPI: Reserving DSDT table memory at [mem 0xbffe0040-0xbffe237e]85gitlab # [ 0.002854] ACPI: Reserving FACS table memory at [mem 0xbffe0000-0xbffe003f]86gitlab # [ 0.002855] ACPI: Reserving APIC table memory at [mem 0xbffe23f3-0xbffe2482]87gitlab # [ 0.002855] ACPI: Reserving HPET table memory at [mem 0xbffe2483-0xbffe24ba]88gitlab # [ 0.002856] ACPI: Reserving WAET table memory at [mem 0xbffe24bb-0xbffe24e2]89gitlab # [ 0.003082] No NUMA configuration found90gitlab # [ 0.003083] Faking a node at [mem 0x0000000000000000-0x00000001bfffffff]91gitlab # [ 0.003085] NODE_DATA(0) allocated [mem 0x1bfffa780-0x1bffffcff]92gitlab # [ 0.005334] Zone ranges:93gitlab # [ 0.005335] DMA [mem 0x0000000000001000-0x0000000000ffffff]94gitlab # [ 0.005337] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]95gitlab # [ 0.005338] Normal [mem 0x0000000100000000-0x00000001bfffffff]96gitlab # [ 0.005339] Device empty97gitlab # [ 0.005339] Movable zone start for each node98gitlab # [ 0.005340] Early memory node ranges99gitlab # [ 0.005340] node 0: [mem 0x0000000000001000-0x000000000009efff]100gitlab # [ 0.005342] node 0: [mem 0x0000000000100000-0x00000000bffd7fff]101gitlab # [ 0.005343] node 0: [mem 0x0000000100000000-0x00000001bfffffff]102gitlab # [ 0.005344] Initmem setup node 0 [mem 0x0000000000001000-0x00000001bfffffff]103gitlab # [ 0.005363] On node 0, zone DMA: 1 pages in unavailable ranges104gitlab # [ 0.005633] On node 0, zone DMA: 97 pages in unavailable ranges105gitlab # [ 0.111667] On node 0, zone Normal: 40 pages in unavailable ranges106gitlab # [ 0.112087] ACPI: PM-Timer IO Port: 0x608107gitlab # [ 0.112102] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])108gitlab # [ 0.112132] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23109gitlab # [ 0.112135] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)110gitlab # [ 0.112136] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)111gitlab # [ 0.112137] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)112gitlab # [ 0.112139] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)113gitlab # [ 0.112139] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)114gitlab # [ 0.112142] ACPI: Using ACPI (MADT) for SMP configuration information115gitlab # [ 0.112143] ACPI: HPET id: 0x8086a201 base: 0xfed00000116gitlab # [ 0.112148] TSC deadline timer available117gitlab # [ 0.112152] CPU topo: Max. logical packages: 1118gitlab # [ 0.112153] CPU topo: Max. logical dies: 1119gitlab # [ 0.112153] CPU topo: Max. dies per package: 1120gitlab # [ 0.112157] CPU topo: Max. threads per core: 1121gitlab # [ 0.112158] CPU topo: Num. cores per package: 4122gitlab # [ 0.112158] CPU topo: Num. threads per package: 4123gitlab # [ 0.112158] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs124gitlab # [ 0.112181] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()125gitlab # [ 0.112199] kvm-guest: KVM setup pv remote TLB flush126gitlab # [ 0.112201] kvm-guest: setup PV sched yield127gitlab # [ 0.112217] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]128gitlab # [ 0.112218] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]129gitlab # [ 0.112219] PM: hibernation: Registered nosave memory: [mem 0xbffd8000-0xffffffff]130gitlab # [ 0.112221] [mem 0xc0000000-0xfeffbfff] available for PCI devices131gitlab # [ 0.112222] Booting paravirtualized kernel on KVM132gitlab # [ 0.112226] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns133gitlab # [ 0.116710] setup_percpu: NR_CPUS:384 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1134gitlab # [ 0.118888] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u524288135gitlab # [ 0.118936] kvm-guest: PV spinlocks enabled136gitlab # [ 0.118937] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)137gitlab # [ 0.118940] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s1kqp7fpf3izg59nbs23h0r0fqspmvjk-nixos-system-gitlab-test/init regInfo=/nix/store/j2s6lqghs4rf6si3djzbvdjaciak0rzs-closure-info/registration console=ttyS0,115200n8 console=tty0138gitlab # [ 0.119035] Unknown kernel command line parameters "regInfo=/nix/store/j2s6lqghs4rf6si3djzbvdjaciak0rzs-closure-info/registration", will be passed to user space.139gitlab # [ 0.119048] random: crng init done140gitlab # [ 0.119049] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes141gitlab # [ 0.127700] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)142gitlab # [ 0.132137] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)143gitlab # [ 0.132214] software IO TLB: area num 4.144gitlab # [ 0.204221] Fallback order for Node 0: 0145gitlab # [ 0.204228] Built 1 zonelists, mobility grouping on. Total pages: 1572726146gitlab # [ 0.204230] Policy zone: Normal147gitlab # [ 0.206608] mem auto-init: stack:all(zero), heap alloc:on, heap free:off148gitlab # [ 0.216159] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1149gitlab # [ 0.228915] allocated 12582912 bytes of page_ext150gitlab # [ 0.238852] ftrace: allocating 48717 entries in 192 pages151gitlab # [ 0.238854] ftrace: allocated 192 pages with 2 groups152gitlab # [ 0.239689] Dynamic Preempt: lazy153gitlab # [ 0.239867] rcu: Preemptible hierarchical RCU implementation.154gitlab # [ 0.239868] rcu: RCU event tracing is enabled.155gitlab # [ 0.239868] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.156gitlab # [ 0.239870] Trampoline variant of Tasks RCU enabled.157gitlab # [ 0.239870] Rude variant of Tasks RCU enabled.158gitlab # [ 0.239871] Tracing variant of Tasks RCU enabled.159gitlab # [ 0.239871] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.160gitlab # [ 0.239872] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4161gitlab # [ 0.239896] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.162gitlab # [ 0.239898] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.163gitlab # [ 0.239899] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.164gitlab # [ 0.244226] NR_IRQS: 24832, nr_irqs: 456, preallocated irqs: 16165gitlab # [ 0.244550] rcu: srcu_init: Setting srcu_struct sizes based on contention.166gitlab # [ 0.244558] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns167gitlab # [ 0.244669] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)168gitlab # [ 0.248245] Console: colour VGA+ 80x25169gitlab # [ 0.248248] printk: legacy console [tty0] enabled170gitlab # [ 0.278669] printk: legacy console [ttyS0] enabled171gitlab # [ 0.383636] ACPI: Core revision 20250807172gitlab # [ 0.384585] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns173gitlab # [ 0.386179] APIC: Switch to symmetric I/O mode setup174gitlab # [ 0.387190] x2apic enabled175gitlab # [ 0.387938] APIC: Switched APIC routing to: physical x2apic176gitlab # [ 0.388848] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()177gitlab # [ 0.390047] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()178gitlab # [ 0.391567] kvm-guest: setup PV IPIs179gitlab # [ 0.393178] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1180gitlab # [ 0.394260] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns181gitlab # [ 0.396033] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)182gitlab # [ 0.398124] x86/cpu: User Mode Instruction Prevention (UMIP) activated183gitlab # [ 0.399156] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127184gitlab # [ 0.401031] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0185gitlab # [ 0.402034] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto186gitlab # [ 0.403031] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl187gitlab # [ 0.404031] Transient Scheduler Attacks: Vulnerable: No microcode188gitlab # [ 0.405031] Spectre V2 : Mitigation: Enhanced / Automatic IBRS189gitlab # [ 0.406031] Speculative Return Stack Overflow: Mitigation: Safe RET190gitlab # [ 0.407030] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization191gitlab # [ 0.409038] Spectre V2 : Enabling IBPB for BPF192gitlab # [ 0.410031] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier193gitlab # [ 0.411031] active return thunk: srso_alias_return_thunk194gitlab # [ 0.412051] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'195gitlab # [ 0.413031] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'196gitlab # [ 0.414031] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'197gitlab # [ 0.415850] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'198gitlab # [ 0.416869] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'199gitlab # [ 0.417846] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'200gitlab # [ 0.419030] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'201gitlab # [ 0.420031] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256202gitlab # [ 0.421030] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64203gitlab # [ 0.422031] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512204gitlab # [ 0.423031] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024205gitlab # [ 0.424030] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8206gitlab # [ 0.425031] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.207gitlab # [ 0.454500] Freeing SMP alternatives memory: 44K208gitlab # [ 0.455034] pid_max: default: 32768 minimum: 301209gitlab # [ 0.456139] LSM: initializing lsm=capability,landlock,yama,bpf,ima210gitlab # [ 0.457130] landlock: Up and running.211gitlab # [ 0.458031] Yama: becoming mindful.212gitlab # [ 0.458862] LSM support for eBPF active213gitlab # [ 0.459742] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)214gitlab # [ 0.461173] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)215gitlab # [ 0.463849] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)216gitlab # [ 0.464576] Performance Events: Fam17h+ core perfctr, AMD PMU driver.217gitlab # [ 0.465035] ... version: 2218gitlab # [ 0.465774] ... bit width: 48219gitlab # [ 0.466033] ... generic counters: 6220gitlab # [ 0.466797] ... generic bitmap: 000000000000003f221gitlab # [ 0.467044] ... fixed-purpose counters: 0222gitlab # [ 0.467814] ... fixed-purpose bitmap: 0000000000000000223gitlab # [ 0.468033] ... value mask: 0000ffffffffffff224gitlab # [ 0.468987] ... max period: 00007fffffffffff225gitlab # [ 0.469747] ... global_ctrl mask: 000000000000003f226gitlab # [ 0.470162] signal: max sigframe size: 3376227gitlab # [ 0.470963] rcu: Hierarchical SRCU implementation.228gitlab # [ 0.471657] rcu: Max phase no-delay instances is 400.229gitlab # [ 0.472248] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level230gitlab # [ 0.477654] smp: Bringing up secondary CPUs ...231gitlab # [ 0.478683] smpboot: x86: Booting SMP configuration:232gitlab # [ 0.479037] .... node #0, CPUs: #1 #2 #3233gitlab # [ 0.482211] smp: Brought up 1 node, 4 CPUs234gitlab # [ 0.483777] smpboot: Total of 4 processors activated (19200.09 BogoMIPS)235gitlab # [ 0.484333] Memory: 6011288K/6290904K available (17210K kernel code, 2726K rwdata, 13576K rodata, 3640K init, 2992K bss, 260100K reserved, 0K cma-reserved)236gitlab # [ 0.485371] devtmpfs: initialized237gitlab # [ 0.486249] x86/mm: Memory block size: 128MB238gitlab # [ 0.489153] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)239gitlab # [ 0.490116] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).240gitlab # [ 0.491137] pinctrl core: initialized pinctrl subsystem241gitlab # [ 0.492385] PM: RTC time: 09:42:49, date: 2026-09-14242gitlab # [ 0.496066] NET: Registered PF_NETLINK/PF_ROUTE protocol family243gitlab # [ 0.498347] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations244gitlab # [ 0.499088] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations245gitlab # [ 0.501120] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations246gitlab # [ 0.502044] audit: initializing netlink subsys (disabled)247gitlab # [ 0.503064] audit: type=2000 audit(1789378969.254:1): state=initialized audit_enabled=0 res=1248gitlab # [ 0.503330] thermal_sys: Registered thermal governor 'fair_share'249gitlab # [ 0.505035] thermal_sys: Registered thermal governor 'bang_bang'250gitlab # [ 0.506034] thermal_sys: Registered thermal governor 'step_wise'251gitlab # [ 0.507033] thermal_sys: Registered thermal governor 'user_space'252gitlab # [ 0.508033] thermal_sys: Registered thermal governor 'power_allocator'253gitlab # [ 0.509049] cpuidle: using governor menu254gitlab # [ 0.511263] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5255gitlab # [ 0.512325] PCI: Using configuration type 1 for base access256gitlab # [ 0.513035] PCI: Using configuration type 1 for extended access257gitlab # [ 0.514217] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.258gitlab # [ 0.517096] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages259gitlab # [ 0.518035] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page260gitlab # [ 0.519033] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages261gitlab # [ 0.520033] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page262gitlab # [ 0.525308] ACPI: Added _OSI(Module Device)263gitlab # [ 0.527046] ACPI: Added _OSI(Processor Device)264gitlab # [ 0.529042] ACPI: Added _OSI(Processor Aggregator Device)265gitlab # [ 0.535963] ACPI: 1 ACPI AML tables successfully acquired and loaded266gitlab # [ 0.542329] ACPI: Interpreter enabled267gitlab # [ 0.544079] ACPI: PM: (supports S0 S3 S4 S5)268gitlab # [ 0.546041] ACPI: Using IOAPIC for interrupt routing269gitlab # [ 0.548080] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug270gitlab # [ 0.551044] PCI: Using E820 reservations for host bridge windows271gitlab # [ 0.554395] ACPI: Enabled 2 GPEs in block 00 to 0F272gitlab # [ 0.566864] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])273gitlab # [ 0.569049] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]274gitlab # [ 0.571857] acpiphp: Slot [3] registered275gitlab # [ 0.574062] acpiphp: Slot [4] registered276gitlab # [ 0.575077] acpiphp: Slot [5] registered277gitlab # [ 0.576103] acpiphp: Slot [6] registered278gitlab # [ 0.578078] acpiphp: Slot [7] registered279gitlab # [ 0.579076] acpiphp: Slot [8] registered280gitlab # [ 0.580092] acpiphp: Slot [9] registered281gitlab # [ 0.582079] acpiphp: Slot [10] registered282gitlab # [ 0.583075] acpiphp: Slot [11] registered283gitlab # [ 0.585078] acpiphp: Slot [12] registered284gitlab # [ 0.586094] acpiphp: Slot [13] registered285gitlab # [ 0.587078] acpiphp: Slot [14] registered286gitlab # [ 0.587910] acpiphp: Slot [15] registered287gitlab # [ 0.588577] acpiphp: Slot [16] registered288gitlab # [ 0.590065] acpiphp: Slot [17] registered289gitlab # [ 0.590802] acpiphp: Slot [18] registered290gitlab # [ 0.591055] acpiphp: Slot [19] registered291gitlab # [ 0.591777] acpiphp: Slot [20] registered292gitlab # [ 0.593064] acpiphp: Slot [21] registered293gitlab # [ 0.593807] acpiphp: Slot [22] registered294gitlab # [ 0.594073] acpiphp: Slot [23] registered295gitlab # [ 0.594808] acpiphp: Slot [24] registered296gitlab # [ 0.595055] acpiphp: Slot [25] registered297gitlab # [ 0.595795] acpiphp: Slot [26] registered298gitlab # [ 0.597054] acpiphp: Slot [27] registered299gitlab # [ 0.597794] acpiphp: Slot [28] registered300gitlab # [ 0.598056] acpiphp: Slot [29] registered301gitlab # [ 0.598795] acpiphp: Slot [30] registered302gitlab # [ 0.600094] acpiphp: Slot [31] registered303gitlab # [ 0.600814] PCI host bridge to bus 0000:00304gitlab # [ 0.601039] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]305gitlab # [ 0.603034] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]306gitlab # [ 0.604043] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]307gitlab # [ 0.605033] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]308gitlab # [ 0.606033] pci_bus 0000:00: root bus resource [mem 0xe0000000000-0xe007fffffff window]309gitlab # [ 0.608034] pci_bus 0000:00: root bus resource [bus 00-ff]310gitlab # [ 0.609689] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 conventional PCI endpoint311gitlab # [ 0.614582] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 conventional PCI endpoint312gitlab # [ 0.619148] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 conventional PCI endpoint313gitlab # [ 0.626127] pci 0000:00:01.1: BAR 4 [io 0xc220-0xc22f]314gitlab # [ 0.628106] pci 0000:00:01.1: BAR 0 [io 0x01f0-0x01f7]: legacy IDE quirk315gitlab # [ 0.631039] pci 0000:00:01.1: BAR 1 [io 0x03f6]: legacy IDE quirk316gitlab # [ 0.633040] pci 0000:00:01.1: BAR 2 [io 0x0170-0x0177]: legacy IDE quirk317gitlab # [ 0.636040] pci 0000:00:01.1: BAR 3 [io 0x0376]: legacy IDE quirk318gitlab # [ 0.638497] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 conventional PCI endpoint319gitlab # [ 0.645226] pci 0000:00:01.2: BAR 4 [io 0xc140-0xc15f]320gitlab # [ 0.649765] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 conventional PCI endpoint321gitlab # [ 0.653729] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI322gitlab # [ 0.657056] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB323gitlab # [ 0.660469] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint324gitlab # [ 0.678149] pci 0000:00:02.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]325gitlab # [ 0.679054] pci 0000:00:02.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]326gitlab # [ 0.680057] pci 0000:00:02.0: ROM [mem 0xfebc0000-0xfebcffff pref]327gitlab # [ 0.682863] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]328gitlab # [ 0.689441] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint329gitlab # [ 0.700081] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]330gitlab # [ 0.702049] pci 0000:00:03.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]331gitlab # [ 0.704512] pci 0000:00:03.0: BAR 4 [mem 0xe0000000000-0xe0000003fff 64bit pref]332gitlab # [ 0.726044] pci 0000:00:03.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]333gitlab # [ 0.728633] pci 0000:00:04.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint334gitlab # [ 0.733064] pci 0000:00:04.0: BAR 0 [io 0xc180-0xc19f]335gitlab # [ 0.733964] pci 0000:00:04.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]336gitlab # [ 0.734820] pci 0000:00:04.0: BAR 4 [mem 0xe0000004000-0xe0000007fff 64bit pref]337gitlab # [ 0.737274] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint338gitlab # [ 0.743067] pci 0000:00:05.0: BAR 0 [io 0xc1a0-0xc1bf]339gitlab # [ 0.744029] pci 0000:00:05.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]340gitlab # [ 0.744841] pci 0000:00:05.0: BAR 4 [mem 0xe0000008000-0xe000000bfff 64bit pref]341gitlab # [ 0.748338] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint342gitlab # [ 0.754064] pci 0000:00:06.0: BAR 0 [io 0xc1c0-0xc1df]343gitlab # [ 0.754982] pci 0000:00:06.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]344gitlab # [ 0.755841] pci 0000:00:06.0: BAR 4 [mem 0xe000000c000-0xe000000ffff 64bit pref]345gitlab # [ 0.758289] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint346gitlab # [ 0.766474] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]347gitlab # [ 0.768050] pci 0000:00:07.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]348gitlab # [ 0.771081] pci 0000:00:07.0: BAR 4 [mem 0xe0000010000-0xe0000013fff 64bit pref]349gitlab # [ 0.775545] pci 0000:00:08.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint350gitlab # [ 0.785066] pci 0000:00:08.0: BAR 0 [io 0xc080-0xc0ff]351gitlab # [ 0.787050] pci 0000:00:08.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]352gitlab # [ 0.789081] pci 0000:00:08.0: BAR 4 [mem 0xe0000014000-0xe0000017fff 64bit pref]353gitlab # [ 0.792364] pci 0000:00:09.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint354gitlab # [ 0.796065] pci 0000:00:09.0: BAR 0 [io 0xc1e0-0xc1ff]355gitlab # [ 0.796969] pci 0000:00:09.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]356gitlab # [ 0.797847] pci 0000:00:09.0: BAR 4 [mem 0xe0000018000-0xe000001bfff 64bit pref]357gitlab # [ 0.799016] pci 0000:00:09.0: ROM [mem 0xfeb80000-0xfebbffff pref]358gitlab # [ 0.802620] pci 0000:00:0a.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint359gitlab # [ 0.805069] pci 0000:00:0a.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]360gitlab # [ 0.806055] pci 0000:00:0a.0: BAR 4 [mem 0xe000001c000-0xe000001ffff 64bit pref]361gitlab # [ 0.808247] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint362gitlab # [ 0.813048] pci 0000:00:0b.0: BAR 0 [io 0xc100-0xc13f]363gitlab # [ 0.814747] pci 0000:00:0b.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]364gitlab # [ 0.815056] pci 0000:00:0b.0: BAR 4 [mem 0xe0000020000-0xe0000023fff 64bit pref]365gitlab # [ 0.818633] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint366gitlab # [ 0.823069] pci 0000:00:0c.0: BAR 0 [io 0xc200-0xc21f]367gitlab # [ 0.824041] pci 0000:00:0c.0: BAR 1 [mem 0xfebda000-0xfebdafff]368gitlab # [ 0.825055] pci 0000:00:0c.0: BAR 4 [mem 0xe0000024000-0xe0000027fff 64bit pref]369gitlab # [ 0.833345] ACPI: PCI: Interrupt link LNKA configured for IRQ 10370gitlab # [ 0.835352] ACPI: PCI: Interrupt link LNKB configured for IRQ 10371gitlab # [ 0.837347] ACPI: PCI: Interrupt link LNKC configured for IRQ 11372gitlab # [ 0.840310] ACPI: PCI: Interrupt link LNKD configured for IRQ 11373gitlab # [ 0.842189] ACPI: PCI: Interrupt link LNKS configured for IRQ 9374gitlab # [ 0.847241] iommu: Default domain type: Translated375gitlab # [ 0.848033] iommu: DMA domain TLB invalidation policy: lazy mode376gitlab # [ 0.849348] ACPI: bus type USB registered377gitlab # [ 0.850124] usbcore: registered new interface driver usbfs378gitlab # [ 0.851054] usbcore: registered new interface driver hub379gitlab # [ 0.851969] usbcore: registered new device driver usb380gitlab # [ 0.853955] NetLabel: Initializing381gitlab # [ 0.854472] NetLabel: domain hash size = 128382gitlab # [ 0.856035] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO383gitlab # [ 0.857077] NetLabel: unlabeled traffic allowed by default384gitlab # [ 0.858043] PCI: Using ACPI for IRQ routing385gitlab # [ 0.859248] pci 0000:00:02.0: vgaarb: setting as boot VGA device386gitlab # [ 0.860029] pci 0000:00:02.0: vgaarb: bridge control possible387gitlab # [ 0.860029] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none388gitlab # [ 0.862039] vgaarb: loaded389gitlab # [ 0.862796] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0390gitlab # [ 0.864035] hpet0: 3 comparators, 64-bit 100.000000 MHz counter391gitlab # [ 0.869393] clocksource: Switched to clocksource kvm-clock392gitlab # [ 0.871005] VFS: Disk quotas dquot_6.6.0393gitlab # [ 0.871769] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)394gitlab # [ 0.873674] pnp: PnP ACPI init395gitlab # [ 0.876535] pnp: PnP ACPI: found 6 devices396gitlab # [ 0.891009] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns397gitlab # [ 0.894611] clocksource: Switched to clocksource acpi_pm398gitlab # [ 0.897158] NET: Registered PF_INET protocol family399gitlab # [ 0.902021] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)400gitlab # [ 0.926809] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)401gitlab # [ 0.928363] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)402gitlab # [ 0.929839] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)403gitlab # [ 0.933830] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)404gitlab # [ 0.935199] TCP: Hash tables configured (established 65536 bind 65536)405gitlab # [ 0.936429] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)406gitlab # [ 0.938064] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)407gitlab # [ 0.939545] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)408gitlab # [ 0.940952] NET: Registered PF_UNIX/PF_LOCAL protocol family409gitlab # [ 0.941996] NET: Registered PF_XDP protocol family410gitlab # [ 0.942888] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]411gitlab # [ 0.943978] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]412gitlab # [ 0.945035] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]413gitlab # [ 0.946193] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window]414gitlab # [ 0.947360] pci_bus 0000:00: resource 8 [mem 0xe0000000000-0xe007fffffff window]415gitlab # [ 0.948768] pci 0000:00:01.0: PIIX3: Enabling Passive Release416gitlab # [ 0.949781] pci 0000:00:00.0: Limiting direct PCI/PCI transfers417gitlab # [ 0.952228] ACPI: \_SB_.LNKD: Enabled at IRQ 11418gitlab # [ 0.954800] PCI: CLS 0 bytes, default 64419gitlab # [ 0.955603] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)420gitlab # [ 0.956115] Trying to unpack rootfs image as initramfs...421gitlab # [ 0.956686] software IO TLB: mapped [mem 0x00000000ba31c000-0x00000000be31c000] (64MB)422gitlab # [ 0.956831] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns423gitlab # [ 0.980291] Initialise system trusted keyrings424gitlab # [ 0.981731] workingset: timestamp_bits=40 max_order=21 bucket_order=0425gitlab # [ 0.993524] Key type asymmetric registered426gitlab # [ 0.994261] Asymmetric key parser 'x509' registered427gitlab # [ 0.995199] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)428gitlab # [ 0.996912] io scheduler mq-deadline registered429gitlab # [ 0.997753] io scheduler kyber registered430gitlab # [ 1.003000] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled431gitlab # [ 1.004369] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A432gitlab # [ 1.006871] Linux agpgart interface v0.103433gitlab # [ 1.007673] ACPI: bus type drm_connector registered434gitlab # [ 1.010013] usbcore: registered new interface driver usbserial_generic435gitlab # [ 1.011136] usbserial: USB Serial support registered for generic436gitlab # [ 1.012203] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.437gitlab # [ 1.012203] Please enable it if your BIOS has the CPPC option.438gitlab # [ 1.014587] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled439gitlab # [ 1.016075] drop_monitor: Initializing network drop monitor service440gitlab # [ 1.017340] NET: Registered PF_INET6 protocol family441gitlab # [ 1.019216] Segment Routing with IPv6442gitlab # [ 1.019929] In-situ OAM (IOAM) with IPv6443gitlab # [ 1.021839] IPI shorthand broadcast: enabled444gitlab # [ 1.026233] sched_clock: Marking stable (882018654, 143472573)->(1049998480, -24507253)445gitlab # [ 1.028139] registered taskstats version 1446gitlab # [ 1.029213] Loading compiled-in X.509 certificates447gitlab # [ 1.039351] Demotion targets for Node 0: null448gitlab # [ 1.040615] Key type .fscrypt registered449gitlab # [ 1.041307] Key type fscrypt-provisioning registered450gitlab # [ 1.042327] ima: No TPM chip found, activating TPM-bypass!451gitlab # [ 1.043295] ima: Allocated hash algorithm: sha1452gitlab # [ 1.044159] ima: No architecture policies found453gitlab # [ 1.045252] PM: Magic number: 10:707:727454gitlab # [ 1.047110] RAS: Correctable Errors collector initialized.455gitlab # [ 1.051631] clk: Disabling unused clocks456gitlab # [ 1.052364] PM: genpd: Disabling unused power domains457gitlab # [ 1.249642] Freeing initrd memory: 29392K458gitlab # [ 1.257163] Freeing unused decrypted memory: 2028K459gitlab # [ 1.263866] Freeing unused kernel image (initmem) memory: 3640K460gitlab # [ 1.266615] Write protecting the kernel read-only data: 32768k461gitlab # [ 1.271666] Freeing unused kernel image (text/rodata gap) memory: 1220K462gitlab # [ 1.275664] Freeing unused kernel image (rodata/data gap) memory: 760K463gitlab # [ 1.343751] x86/mm: Checked W+X mappings: passed, no W+X pages found.464gitlab # [ 1.344939] Run /init as init process465gitlab # [ 1.357322] systemd[1]: Inserted module 'autofs4'466gitlab # [ 1.382202] fuse: init (API version 7.45)467gitlab # [ 1.390380] ACPI: \_SB_.LNKC: Enabled at IRQ 10468gitlab # [ 1.397425] ACPI: \_SB_.LNKA: Enabled at IRQ 10469gitlab # [ 1.400931] ACPI: \_SB_.LNKB: Enabled at IRQ 11470gitlab # [ 1.436567] systemd[1]: Successfully made /usr/ read-only.471gitlab # [ 1.772593] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)472gitlab # [ 1.788851] systemd[1]: Detected virtualization kvm.473gitlab # [ 1.789758] systemd[1]: Detected architecture x86-64.474gitlab # [ 1.790635] systemd[1]: Running in initrd.475gitlab # [ 1.791791] systemd[1]: Initializing machine ID from random generator.476gitlab # [ 1.793026] systemd[1]: Hostname set to <gitlab>.477gitlab # [ 1.914012] systemd[1]: bpf-restrict-fs: LSM BPF program attached478gitlab # [ 1.969282] systemd[1]: Queued start job for default target Initrd Default Target.479gitlab # [ 1.977335] systemd[1]: Created slice Slice /system/modprobe.480gitlab # [ 1.978513] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.481gitlab # [ 1.979883] systemd[1]: Expecting device /dev/disk/by-label/nix-store...482gitlab # [ 1.981057] systemd[1]: Expecting device /dev/disk/by-label/nixos...483gitlab # [ 1.982147] systemd[1]: Reached target Path Units.484gitlab # [ 1.983012] systemd[1]: Reached target Slice Units.485gitlab # [ 1.983892] systemd[1]: Reached target Swaps.486gitlab # [ 1.984675] systemd[1]: Reached target Timer Units.487gitlab # [ 1.985619] systemd[1]: Listening on D-Bus System Message Bus Socket.488gitlab # [ 1.986817] systemd[1]: Listening on Journal Socket (/dev/log).489gitlab # [ 1.987929] systemd[1]: Listening on Journal Sockets.490gitlab # [ 1.988920] systemd[1]: Listening on udev Control Socket.491gitlab # [ 1.989927] systemd[1]: Listening on udev Kernel Socket.492gitlab # [ 1.990857] systemd[1]: Reached target Socket Units.493gitlab # [ 1.992924] systemd[1]: Starting Create List of Static Device Nodes...494gitlab # [ 1.995086] systemd[1]: Starting Load Kernel Module 9pnet_virtio...495gitlab # [ 1.997136] systemd[1]: Starting Load Kernel Module configfs...496gitlab # [ 2.000411] systemd[1]: Starting Journal Service...497gitlab # [ 2.007785] systemd[1]: Starting Load Kernel Modules...498gitlab # [ 2.008797] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os499gitlab # [ 2.013558] systemd[1]: Starting Coldplug All udev Devices...500gitlab # [ 2.015808] systemd[1]: Finished Create List of Static Device Nodes.501gitlab # [ 2.017645] systemd[1]: modprobe@configfs.service: Deactivated successfully.502gitlab # [ 2.020891] systemd[1]: Finished Load Kernel Module configfs.503gitlab # [ 2.021260] systemd-journald[91]: Collecting audit messages is disabled.504gitlab # [ 2.022286] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config505gitlab # [ 2.032573] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...506gitlab # [ 2.055236] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.507gitlab # [ 2.055365] netfs: FS-Cache loaded508gitlab # [ 2.058736] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev509gitlab # [ 2.064501] 9pnet: Installing 9P2000 support510gitlab # [ 2.065026] systemd[1]: Finished Load Kernel Modules.511gitlab # [ 2.069294] systemd[1]: Starting Apply Kernel Variables...512gitlab # [ 2.070766] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.513gitlab # [ 2.077873] systemd[1]: Finished Load Kernel Module 9pnet_virtio.514gitlab # [ 2.079955] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.515gitlab # [ 1.937474] systemd-modules-load[95]: Using 4 probe threads516gitlab # [ 2.081717] systemd[1]: Started Journal Service.517gitlab # [ 1.939226] systemd-modules-load[95]: Inserted module 'virtio_balloon'518gitlab # [ 1.940805] systemd-modules-load[95]: Inserted module 'dm_mod'519gitlab # [ 1.941886] systemd-modules-load[95]: Inserted module 'virtio_gpu'520gitlab # [ 1.942924] systemd[1]: Finished Apply Kernel Variables.521gitlab # [ 1.944496] systemd[1]: Starting Create Static Device Nodes in /dev...522gitlab # [ 1.956817] systemd[1]: Finished Create Static Device Nodes in /dev.523gitlab # [ 1.957769] systemd[1]: Reached target Preparation for Local File Systems.524gitlab # [ 1.958729] systemd[1]: Reached target Local File Systems.525gitlab # [ 1.959536] systemd[1]: Starting Create System Files and Directories...526gitlab # [ 1.960498] systemd[1]: Starting Rule-based Manager for Device Events and Files...527gitlab # [ 1.976201] systemd[1]: Finished Create System Files and Directories.528gitlab # [ 1.985832] systemd-udevd[115]: Using default interface naming scheme 'v261'.529gitlab # [ 1.996527] systemd[1]: Started Rule-based Manager for Device Events and Files.530gitlab # [ 2.007197] systemd[1]: Finished Coldplug All udev Devices.531gitlab # [ 2.008097] systemd[1]: Reached target System Initialization.532gitlab # [ 2.008871] systemd[1]: Reached target Basic System.533gitlab # [ 2.254546] uhci_hcd 0000:00:01.2: UHCI Host Controller534gitlab # [ 2.255507] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1535gitlab # [ 2.256693] uhci_hcd 0000:00:01.2: detected 2 ports536gitlab # [ 2.257746] uhci_hcd 0000:00:01.2: irq 11, io port 0x0000c140537gitlab # [ 2.258894] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18538gitlab # [ 2.260126] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1539gitlab # [ 2.261172] usb usb1: Product: UHCI Host Controller540gitlab # [ 2.261930] usb usb1: Manufacturer: Linux 6.18.43 uhci_hcd541gitlab # [ 2.262790] usb usb1: SerialNumber: 0000:00:01.2542gitlab # [ 2.263830] hub 1-0:1.0: USB hub found543gitlab # [ 2.264408] hub 1-0:1.0: 2 ports detected544gitlab # [ 2.272881] SCSI subsystem initialized545gitlab # [ 2.277743] virtio_blk virtio4: 4/0/0 default/read/poll queues546gitlab # [ 2.279297] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12547gitlab # [ 2.288334] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)548gitlab # [ 2.299026] serio: i8042 KBD port at 0x60,0x64 irq 1549gitlab # [ 2.299967] serio: i8042 AUX port at 0x60,0x64 irq 12550gitlab # [ 2.301062] virtio_blk virtio5: 4/0/0 default/read/poll queues551gitlab # [ 2.308999] virtio_blk virtio5: [vdb] 11843776 512-byte logical blocks (6.06 GB/5.65 GiB)552gitlab # [ 2.315900] scsi host0: ata_piix553gitlab # [ 2.316815] scsi host1: ata_piix554gitlab # [ 2.317526] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc220 irq 14 lpm-pol 0555gitlab # [ 2.318619] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc228 irq 15 lpm-pol 0556gitlab # [ 2.188543] (udev-worker)[129]: Network interface NamePolicy= disabled on kernel command line.557gitlab # [ 2.192950] (udev-worker)[121]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.558gitlab # [ 2.195543] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line.559gitlab # [ 2.197316] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 2.206330] systemd[1]: Found device /dev/disk/by-label/nixos.561gitlab # [ 2.207513] systemd[1]: Reached target Initrd Root Device.562gitlab # [ 2.208424] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...563gitlab # [ 2.215211] systemd[1]: Found device /dev/disk/by-label/nix-store.564gitlab # [ 2.220569] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones.565gitlab # [ 2.223294] systemd[1]: Finished Virtual Console Setup.566gitlab # [ 2.229609] systemd-fsck[159]: nixos: clean, 12/65536 files, 13019/262144 blocks567gitlab # [ 2.232565] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.568gitlab # [ 2.484918] ata2: found unknown device (class 0)569gitlab # [ 2.486743] usb 1-1: new full-speed USB device number 2 using uhci_hcd570gitlab # [ 2.489113] ata2.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100571gitlab # [ 2.492831] scsi 1:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5572gitlab # [ 2.511618] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0573gitlab # [ 2.546824] sr 1:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray574gitlab # [ 2.574195] cdrom: Uniform CD-ROM driver Revision: 3.20575gitlab # [ 2.653718] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00576gitlab # [ 2.656630] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10577gitlab # [ 2.659201] usb 1-1: Product: QEMU USB Tablet578gitlab # [ 2.660885] usb 1-1: Manufacturer: QEMU579gitlab # [ 2.662343] usb 1-1: SerialNumber: 28754-0000:00:01.2-1580gitlab # [ 2.679569] hid: raw HID events driver (C) Jiri Kosina581gitlab # [ 2.687412] usbcore: registered new interface driver usbhid582gitlab # [ 2.688283] usbhid: USB HID core driver583gitlab # [ 2.692535] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2584gitlab # [ 2.694214] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0585gitlab # [ 2.875343] systemd[1]: Mounting /sysroot...586gitlab # [ 3.153016] EXT4-fs (vda): mounted filesystem 5ed49a1c-9007-467a-9fda-ac0d8e9562bc r/w with ordered data mode. Quota mode: none.587gitlab # [ 3.015984] systemd[1]: Mounted /sysroot.588gitlab # [ 3.017727] systemd[1]: Reached target Initrd Root File System.589gitlab # [ 3.019766] systemd[1]: Mounting /sysroot/nix/.ro-store...590gitlab # [ 3.021607] systemd[1]: Mounting /sysroot/nix/.rw-store...591gitlab # [ 3.024454] systemd[1]: Mounting /sysroot/run...592gitlab # [ 3.026248] systemd[1]: Mounting /sysroot/tmp/shared...593gitlab # [ 3.034215] systemd[1]: Mounting /sysroot/tmp/xchg...594gitlab # [ 3.036519] systemd[1]: Starting Mountpoints Configured in the Real Root...595gitlab # [ 3.188046] 9p: Installing v9fs 9p2000 file system support596gitlab # [ 3.050166] systemd[1]: Mounted /sysroot/nix/.rw-store.597gitlab # [ 3.051286] systemd[1]: Mounted /sysroot/run.598gitlab # [ 3.053632] systemd-sysroot-fstab-check[178]: /sysroot should be mounted in the initrd, will request daemon-reload.599gitlab # [ 3.055180] systemd[1]: Mounted /sysroot/tmp/shared.600gitlab # [ 3.056936] systemd[1]: Mounted /sysroot/tmp/xchg.601gitlab # [ 3.061190] systemd[1]: Starting rw-sysroot-nix-store.service...602gitlab # [ 3.062772] systemd[1]: Reload requested from client PID 178 ('systemd-sysroot') (unit initrd-parse-etc.service)...603gitlab # [ 3.064611] systemd[1]: Reloading...604gitlab # [ 3.210924] erofs (device vdb): mounted with root inode @ nid 128.605gitlab # [ 3.129428] systemd[1]: Reloading finished in 63 ms.606gitlab # [ 3.152966] systemd-sysroot-fstab-check[178]: Requesting initrd-fs.target/start/replace...607gitlab # [ 3.156935] systemd[1]: Mounted /sysroot/nix/.ro-store.608gitlab # [ 3.158895] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.609gitlab # [ 3.161481] systemd[1]: Finished rw-sysroot-nix-store.service.610gitlab # [ 3.163624] systemd-sysroot-fstab-check[178]: Requesting swap.target/start/replace...611gitlab # [ 3.166615] systemd[1]: initrd-parse-etc.service: Deactivated successfully.612gitlab # [ 3.169183] systemd[1]: Finished Mountpoints Configured in the Real Root.613gitlab # [ 3.171517] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.614gitlab # [ 3.174152] systemd[1]: Starting rw-sysroot-nix-store.service...615gitlab # [ 3.182901] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616gitlab # [ 3.185634] systemd[1]: Finished rw-sysroot-nix-store.service.617gitlab # [ 3.876117] systemd[1]: Mounting /sysroot/nix/store...618gitlab # [ 3.933272] systemd[1]: Mounted /sysroot/nix/store.619gitlab # [ 3.935225] systemd[1]: Reached target Initrd File Systems.620gitlab # [ 3.937583] systemd[1]: Starting Find NixOS closure...621gitlab # [ 3.939417] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...622gitlab # [ 3.978509] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.623gitlab # [ 3.981379] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.624gitlab # [ 4.000602] systemd[1]: Finished Find NixOS closure.625gitlab # [ 4.002410] systemd[1]: Reached target Initrd Default Target.626gitlab # [ 4.004985] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...627gitlab # [ 4.034886] systemd[1]: Stopped target Initrd Default Target.628gitlab # [ 4.036986] systemd[1]: Stopped target Basic System.629gitlab # [ 4.038813] systemd[1]: Stopped target Initrd Root Device.630gitlab # [ 4.040728] systemd[1]: Stopped target Path Units.631gitlab # [ 4.042428] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.632gitlab # [ 4.045129] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.633gitlab # [ 4.047655] systemd[1]: Stopped target Slice Units.634gitlab # [ 4.049401] systemd[1]: Stopped target Socket Units.635gitlab # [ 4.051175] systemd[1]: Stopped target System Initialization.636gitlab # [ 4.055170] systemd[1]: Stopped target Swaps.637gitlab # [ 4.062185] systemd[1]: Stopped target Timer Units.638gitlab # [ 4.064528] systemd[1]: dbus.socket: Deactivated successfully.639gitlab # [ 4.066928] systemd[1]: Closed D-Bus System Message Bus Socket.640gitlab # [ 4.069562] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.641gitlab # [ 4.072186] systemd[1]: Stopped Find NixOS closure.642gitlab # [ 4.074148] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio643gitlab # [ 4.077829] systemd[1]: Starting rw-sysroot-nix-store.service...644gitlab # [ 4.079443] systemd[1]: systemd-sysctl.service: Deactivated successfully.645gitlab # [ 4.081222] systemd[1]: Stopped Apply Kernel Variables.646gitlab # [ 4.082663] systemd[1]: systemd-modules-load.service: Deactivated successfully.647gitlab # [ 4.084518] systemd[1]: Stopped Load Kernel Modules.648gitlab # [ 4.085873] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.649gitlab # [ 4.087893] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.650gitlab # [ 4.090092] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.651gitlab # [ 4.091955] systemd[1]: Stopped Create System Files and Directories.652gitlab # [ 4.093634] systemd[1]: Stopped target Local File Systems.653gitlab # [ 4.095109] systemd[1]: Stopped target Preparation for Local File Systems.654gitlab # [ 4.096860] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.655gitlab # [ 4.097978] systemd[1]: Stopped Coldplug All udev Devices.656gitlab # [ 4.098951] systemd[1]: Stopping Rule-based Manager for Device Events and Files...657gitlab # [ 4.100137] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.658gitlab # [ 4.101214] systemd[1]: Stopped Virtual Console Setup.659gitlab # [ 4.102103] systemd[1]: initrd-cleanup.service: Deactivated successfully.660gitlab # [ 4.103149] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.661gitlab # [ 4.104115] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.662gitlab # [ 4.105082] systemd[1]: Finished rw-sysroot-nix-store.service.663gitlab # [ 4.105851] systemd[1]: systemd-udevd.service: Deactivated successfully.664gitlab # [ 4.106724] systemd[1]: Stopped Rule-based Manager for Device Events and Files.665gitlab # [ 4.107671] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.666gitlab # [ 4.108658] systemd[1]: Closed udev Control Socket.667gitlab # [ 4.109418] systemd[1]: Starting Cleanup udev Database...668gitlab # [ 4.110275] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.669gitlab # [ 4.111341] systemd[1]: Stopped Create Static Device Nodes in /dev.670gitlab # [ 4.112161] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.671gitlab # [ 4.113198] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.672gitlab # [ 4.114147] systemd[1]: kmod-static-nodes.service: Deactivated successfully.673gitlab # [ 4.115055] systemd[1]: Stopped Create List of Static Device Nodes.674gitlab # [ 4.130997] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.675gitlab # [ 4.132086] systemd[1]: Finished Cleanup udev Database.676gitlab # [ 4.132779] systemd[1]: Reached target Switch Root.677gitlab # [ 4.134047] systemd[1]: Starting NixOS Activation...678gitlab # [ 4.245927] initrd-nixos-activation-start[228]: booting system configuration /nix/store/s1kqp7fpf3izg59nbs23h0r0fqspmvjk-nixos-system-gitlab-test679gitlab # [ 4.295472] initrd-nixos-activation-start[228]: running activation script...680gitlab # [ 4.533558] initrd-nixos-activation-start[251]: setting up /etc...681gitlab # [ 4.651947] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.682gitlab # [ 4.653223] systemd[1]: Finished NixOS Activation.683gitlab # [ 4.655758] systemd[1]: Starting Switch Root...684gitlab # [ 4.686653] systemd[1]: Switching root.685gitlab # [ 4.885599] systemd-journald[91]: Received SIGTERM from PID 1 (systemd).686gitlab # [ 4.978415] NET: Registered PF_VSOCK protocol family687gitlab # [ 5.344586] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)688gitlab # [ 5.353949] systemd[1]: Detected virtualization kvm.689gitlab # [ 5.355814] systemd[1]: Detected architecture x86-64.690gitlab # [ 5.357771] systemd[1]: Detected first boot.691gitlab # [ 5.360374] systemd[1]: Initializing machine ID from random generator.692gitlab # [ 5.501099] systemd[1]: bpf-restrict-fs: LSM BPF program attached693gitlab # [ 5.581888] systemd[1]: Applying preset policy.694gitlab # [ 5.736385] systemd[1]: Populated /etc with preset unit settings.695gitlab # [ 5.852631] systemd[1]: initrd-switch-root.service: Deactivated successfully.696gitlab # [ 5.853979] systemd[1]: Stopped initrd-switch-root.service.697gitlab # [ 5.856628] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.698gitlab # [ 5.858742] systemd[1]: Created slice Slice /system/getty.699gitlab # [ 5.860151] systemd[1]: Created slice GitLab DevOps Platform Slice.700gitlab # [ 5.861726] systemd[1]: Created slice User and Session Slice.701gitlab # [ 5.862722] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.702gitlab # [ 5.863990] systemd[1]: Started Forward Password Requests to Wall Directory Watch.703gitlab # [ 5.865202] systemd[1]: Expecting device /dev/hvc0...704gitlab # [ 5.865943] systemd[1]: Expecting device /dev/ttyS0...705gitlab # [ 5.866725] systemd[1]: Reached target Local Encrypted Volumes.706gitlab # [ 5.867571] systemd[1]: Stopped target initrd-fs.target.707gitlab # [ 5.868315] systemd[1]: Stopped target initrd-root-fs.target.708gitlab # [ 5.869216] systemd[1]: Stopped target initrd-switch-root.target.709gitlab # [ 5.870143] systemd[1]: Reached target Virtual Machines and Containers.710gitlab # [ 5.871154] systemd[1]: Reached target Path Units.711gitlab # [ 5.871902] systemd[1]: Reached target Remote File Systems.712gitlab # [ 5.873057] systemd[1]: Reached target Slice Units.713gitlab # [ 5.875154] systemd[1]: Reached target Swaps.714gitlab # [ 5.879018] systemd[1]: Listening on Query the User Interactively for a Password.715gitlab # [ 5.883918] systemd[1]: Listening on Process Core Dump Socket.716gitlab # [ 5.887402] systemd[1]: Listening on Credential Encryption/Decryption.717gitlab # [ 5.891302] systemd[1]: Listening on Factory Reset Management.718gitlab # [ 5.893768] systemd[1]: Listening on Hostname Service Socket.719gitlab # [ 5.899726] systemd[1]: Starting Journal Log Access Socket...720gitlab # [ 5.902857] systemd[1]: Listening on Journal Audit Socket.721gitlab # [ 5.906958] systemd[1]: Listening on Console Output Muting Service Socket.722gitlab # [ 5.909841] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.723gitlab # [ 5.912690] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os724gitlab # [ 5.916101] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki725gitlab # [ 5.922576] systemd[1]: Listening on Disk Repartitioning Service Socket.726gitlab # [ 5.925229] systemd[1]: Listening on udev Control Socket.727gitlab # [ 5.927108] systemd[1]: Listening on udev Varlink Socket.728gitlab # [ 5.931550] systemd[1]: Mounting Huge Pages File System...729gitlab # [ 5.935331] systemd[1]: Mounting POSIX Message Queue File System...730gitlab # [ 5.939234] systemd[1]: Mounting Kernel Debug File System...731gitlab # [ 5.944676] systemd[1]: Mounting Kernel Trace File System...732gitlab # [ 5.949837] systemd[1]: Starting Create List of Static Device Nodes...733gitlab # [ 5.950882] systemd[1]: Load Kernel Module 9pnet_virtio skipped, unmet condition check ConditionKernelModuleLoaded=!9pnet_virtio734gitlab # [ 5.954107] systemd[1]: Starting Load Kernel Module configfs...735gitlab # [ 5.955188] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm736gitlab # [ 5.956906] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore737gitlab # [ 5.958562] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse738gitlab # [ 5.967757] systemd[1]: Mounting FUSE Control File System...739gitlab # [ 5.981793] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67740gitlab # [ 5.986942] systemd[1]: Starting Journal Service...741gitlab # [ 5.989031] systemd[1]: Starting Load Kernel Modules...742gitlab # [ 5.995186] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...743gitlab # [ 5.997981] systemd[1]: Starting Remount Root and Kernel File Systems...744gitlab # [ 5.999063] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os745gitlab # [ 6.005952] systemd[1]: Starting Coldplug All udev Devices...746gitlab # [ 6.009204] systemd[1]: Listening on Journal Log Access Socket.747gitlab # [ 6.009217] systemd-journald[322]: Collecting audit messages is enabled.748gitlab # [ 6.009657] systemd[1]: Mounted Huge Pages File System.749gitlab # [ 6.012558] systemd[1]: Mounted POSIX Message Queue File System.750gitlab # [ 6.013521] systemd[1]: Mounted Kernel Debug File System.751gitlab # [ 6.014416] systemd[1]: Mounted Kernel Trace File System.752gitlab # [ 6.020457] systemd[1]: Finished Create List of Static Device Nodes.753gitlab # [ 6.021807] systemd[1]: modprobe@configfs.service: Deactivated successfully.754gitlab # [ 6.023091] loop: module loaded755gitlab # [ 6.023346] systemd[1]: Finished Load Kernel Module configfs.756gitlab # [ 6.024751] EXT4-fs (vda): re-mounted 5ed49a1c-9007-467a-9fda-ac0d8e9562bc.757gitlab # [ 6.027247] systemd[1]: Mounted FUSE Control File System.758gitlab # [ 6.028935] systemd[1]: Finished Load Kernel Modules.759gitlab # [ 5.886664] systemd[1]: Queued start job for default target Multi-User System.[ 6.030381] systemd[1]: Finished Remount Root and Kernel File Systems.760gitlab # 761gitlab # [ 6.032311] systemd[1]: Started Journal Service.762gitlab # [ 5.889058] systemd[1]: Unnecessary job was removed for /dev/vdb.763gitlab # [ 5.890856] systemd[1]: systemd-journald.service: Deactivated successfully.764gitlab # [ 5.892749] systemd-modules-load[323]: Using 3 probe threads765gitlab # [ 5.893962] systemd-modules-load[323]: Inserted module 'loop'766gitlab # [ 5.894971] systemd-modules-load[323]: Inserted module 'tls'767gitlab # [ 5.895949] systemd[1]: Listening on Disk Image Download Service Socket.768gitlab # [ 5.897201] systemd[1]: Mounting Kernel Configuration File System...769gitlab # [ 5.901300] systemd[1]: Starting Firewall...770gitlab # [ 5.902280] systemd[1]: Starting Flush Journal to Persistent Storage...771gitlab # [ 5.903474] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore772gitlab # [ 5.905817] systemd-oomd[325]: No swap; memory pressure usage will be degraded773gitlab # [ 5.909065] systemd[1]: Starting Load/Save OS Random Seed...774gitlab # [ 5.912168] systemd[1]: Starting Apply Kernel Variables...775gitlab # [ 5.915148] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...776gitlab # [ 5.916324] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777gitlab # [ 5.917691] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.778gitlab # [ 5.918671] systemd[1]: Mounted Kernel Configuration File System.779gitlab # [ 6.063420] systemd-journald[322]: Received client request to flush runtime journal.780gitlab # [ 5.957431] systemd[1]: Finished Load/Save OS Random Seed.781gitlab # [ 5.960297] systemd[1]: Finished Apply Kernel Variables.782gitlab # [ 5.961372] systemd[1]: Reached target First Boot Complete.783gitlab # [ 5.962331] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.784gitlab # [ 5.963549] systemd[1]: Starting Create Static Device Nodes in /dev...785gitlab # [ 5.964573] systemd[1]: Finished Flush Journal to Persistent Storage.786gitlab # [ 5.967684] systemd[1]: Finished Create Static Device Nodes in /dev.787gitlab # [ 5.969511] systemd[1]: Reached target Preparation for Local File Systems.788gitlab # [ 5.972221] systemd[1]: Starting Rule-based Manager for Device Events and Files...789gitlab # [ 6.001697] systemd-udevd[362]: Using default interface naming scheme 'v261'.790gitlab # [ 6.011443] systemd[1]: Finished Coldplug All udev Devices.791gitlab # [ 6.030624] systemd[1]: Started Rule-based Manager for Device Events and Files.792gitlab # [ 6.101327] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse793gitlab # [ 6.134801] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped.794gitlab # [ 6.137617] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.795gitlab # [ 6.139161] (udev-worker)[417]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.796gitlab # [ 6.141539] (udev-worker)[417]: Network interface NamePolicy= disabled on kernel command line.797gitlab # [ 6.143468] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line.798gitlab # [ 6.162601] systemd[1]: Condition check resulted in Virtio network device being skipped.799gitlab # [ 6.164170] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore800gitlab # [ 6.166115] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67801gitlab # [ 6.168669] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore802gitlab # [ 6.170353] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os803gitlab # [ 6.171799] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os804gitlab # [ 6.199098] systemd[1]: Finished Firewall.805gitlab # [ 6.352585] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3806gitlab # [ 6.355747] bochs-drm 0000:00:02.0: vgaarb: deactivate vga console807gitlab # [ 6.366503] ACPI: button: Power Button [PWRF]808gitlab # [ 6.368074] Console: switching to colour dummy device 80x25809gitlab # [ 6.369415] [drm] Found bochs VGA, ID 0xb0c5.810gitlab # [ 6.369417] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.811gitlab # [ 6.371162] bochs-drm 0000:00:02.0: [drm] Registered 1 planes with drm panic812gitlab # [ 6.372001] [drm] Initialized bochs-drm 1.0.0 for 0000:00:02.0 on minor 0813gitlab # [ 6.383152] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0814gitlab # [ 6.384067] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD815gitlab # [ 6.393644] mousedev: PS/2 mouse device common for all mice816gitlab # [ 6.396437] Console: switching to colour frame buffer device 160x50817gitlab # [ 6.398738] bochs-drm 0000:00:02.0: [drm] fb0: bochs-drmdrmfb frame buffer device818gitlab # [ 6.406368] parport_pc 00:03: reported by Plug and Play ACPI819gitlab # [ 6.407422] Floppy drive(s): fd0 is 2.88M AMI BIOS820gitlab # [ 6.408705] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]821gitlab # [ 6.414070] rtc_cmos 00:05: RTC can wake from S4822gitlab # [ 6.416248] rtc_cmos 00:05: registered as rtc0823gitlab # [ 6.416923] rtc_cmos 00:05: setting system clock to 2026-09-14T09:42:54 UTC (1789378974)824gitlab # [ 6.418341] systemd-journald[322]: Time jumped backwards, rotating.825gitlab # [ 6.418377] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs826gitlab # [ 6.420703] FDC 0 is a S82078B827gitlab # [ 6.450657] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:0a.0/virtio7/input/input4828gitlab # [ 6.360646] systemd[1]: Starting Virtual Console Setup...829gitlab # [ 6.375681] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.830gitlab # [ 6.380405] systemd[1]: Stopped Virtual Console Setup.831gitlab # [ 6.405983] systemd[1]: Starting Virtual Console Setup...832gitlab # [ 6.552730] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input6833gitlab # [ 6.557984] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5834gitlab # [ 6.588200] kvm_amd: TSC scaling supported835gitlab # [ 6.588779] kvm_amd: Nested Virtualization enabled836gitlab # [ 6.589302] kvm_amd: Nested Paging enabled837gitlab # [ 6.589806] kvm_amd: LBR virtualization supported838gitlab # [ 6.590414] kvm_amd: Virtual VMLOAD VMSAVE supported839gitlab # [ 6.591114] kvm_amd: Virtual GIF supported840gitlab # [ 6.591738] kvm_amd: Virtual NMI enabled841gitlab # [ 6.622682] ppdev: user-space parallel port driver842gitlab # [ 6.483993] systemd-vconsole-setup[494]: Configuration of first virtual console was skipped, ignoring remaining ones.843gitlab # [ 6.485800] systemd[1]: Finished Virtual Console Setup.844gitlab # [ 6.631002] EDAC MC: Ver: 3.0.0845gitlab # [ 6.714440] systemd[1]: Mounting /run/wrappers...846gitlab # [ 6.737529] systemd[1]: Mounted /run/wrappers.847gitlab # [ 6.739044] systemd[1]: Reached target Local File Systems.848gitlab # [ 6.740705] systemd[1]: Listening on Boot Loader Control Service Socket.849gitlab # [ 6.743277] systemd[1]: Starting register-nix-paths.service...850gitlab # [ 6.745813] systemd[1]: Starting Create SUID/SGID Wrappers...851gitlab # [ 6.747526] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.852gitlab # [ 6.750004] systemd[1]: Starting Save Transient machine-id to Disk...853gitlab # [ 6.755188] systemd[1]: Starting Create System Files and Directories...854gitlab # [ 6.787938] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855gitlab # [ 6.791276] systemd[1]: Finished Save Transient machine-id to Disk.856gitlab # [ 6.805973] systemd[1]: Finished Create System Files and Directories.857gitlab # [ 6.810609] systemd[1]: Starting Rebuild Journal Catalog...858gitlab # [ 6.812713] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859gitlab # [ 6.835327] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860gitlab # [ 6.847106] systemd[1]: Finished Rebuild Journal Catalog.861gitlab # [ 6.848769] systemd[1]: Starting Update is Completed...862gitlab # [ 6.867443] systemd[1]: Finished Update is Completed.863gitlab # [ 6.894229] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.864gitlab # [ 6.895420] systemd[1]: Finished Create SUID/SGID Wrappers.865gitlab # [ 7.121608] systemd[1]: Finished register-nix-paths.service.866gitlab # [ 7.123618] systemd[1]: Reached target System Initialization.867gitlab # [ 7.125409] systemd[1]: Started Discard unused filesystem blocks once a week.868gitlab # [ 7.127885] systemd[1]: Started logrotate.timer.869gitlab # [ 7.129720] systemd[1]: Started Daily Cleanup of Temporary Directories.870gitlab # [ 7.132278] systemd[1]: Reached target Timer Units.871gitlab # [ 7.134108] systemd[1]: Listening on D-Bus System Message Bus Socket.872gitlab # [ 7.136307] systemd[1]: Listening on Nix Daemon Socket.873gitlab # [ 7.138683] systemd[1]: Starting nixbot CI service socket...874gitlab # [ 7.141113] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.875gitlab # [ 7.151371] systemd[1]: Starting D-Bus System Message Bus...876gitlab # [ 7.153207] systemd[1]: Listening on nixbot CI service socket.877gitlab # [ 7.155024] systemd[1]: Reached target Socket Units.878gitlab # [ 7.216614] dbus-broker-launch[576]: Looking up NSS user entry for 'systemd-timesync'...879gitlab # [ 7.218376] dbus-broker-launch[576]: NSS returned no entry for 'systemd-timesync'880gitlab # [ 7.219783] dbus-broker-launch[576]: Invalid user-name in /nix/store/37yal9w16hfdxjh64sww8gn81f4hma6i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"881gitlab # [ 7.222951] systemd[1]: Started D-Bus System Message Bus.882gitlab # [ 7.235872] dbus-broker-launch[576]: Ready883gitlab # [ 7.238281] systemd[1]: Reached target Basic System.884gitlab # [ 7.241423] systemd[1]: Started backdoor.service.885gitlab # [ 7.243902] systemd[1]: Starting gitlab-config.service...886gitlab # [ 7.248678] systemd[1]: Starting Import lastlog data into lastlog2 database...887gitlab # [ 7.262151] systemd[1]: Starting Logrotate configuration check...888gitlab # [ 7.265104] systemd[1]: Starting Name Service Cache Daemon (nsncd)...889gitlab # [ 7.275421] systemd[1]: Starting Post-Boot Actions...890gitlab # [ 7.280078] systemd[1]: Started Reset console on configuration changes.891gitlab # [ 7.286865] logrotate[581]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.892gitlab # [ 7.289620] logrotate[581]: reading config file /nix/store/y3500wq742i80l631mh8nc8rchpsfb9q-logrotate.conf893gitlab # [ 7.291196] logrotate[581]: note: 'monthly' overrides previously specified 'weekly'894gitlab # connecting to host...895gitlab # [ 7.292382] logrotate[581]: Reading state from file: /var/lib/logrotate.status896gitlab # [ 7.293802] logrotate[581]: state file /var/lib/logrotate.status does not exist897gitlab # [ 7.295080] logrotate[581]: Allocating hash table for state file, size 64 entries898gitlab # [ 7.296128] logrotate[581]: Handling 4 logs899gitlab # [ 7.296900] logrotate[581]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed900gitlab # [ 7.299190] logrotate[581]: considering log /var/log/btmp901gitlab # [ 7.299916] logrotate[581]: Creating new state902gitlab # [ 7.300734] logrotate[581]: Now: 2026-09-14 09:42903gitlab # [ 7.301516] logrotate[581]: Last rotated at 2026-09-14 09:00904gitlab # [ 7.302473] logrotate[581]: log does not need rotating (log has already been rotated)905gitlab # [ 7.303609] logrotate[581]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed906gitlab # [ 7.306420] logrotate[581]: considering log /var/log/wtmp907gitlab # [ 7.307268] logrotate[581]: Creating new state908gitlab # [ 7.307920] logrotate[581]: Now: 2026-09-14 09:42909gitlab: Guest shell says: b'Spawning backdoor root shell...\n'910gitlab # [ 7.308651] logrotate[581]: Last rotated at 2026-09-14 09:00911gitlab: connected to guest root shell912gitlab # [ 7.309525] logrotate[581]: log does not need rotating (log has already been rotated)913gitlab: (connecting took 7.94 seconds)914gitlab # [ 7.310512] logrotate[581]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed915gitlab: (finished: waiting for the VM to finish booting, in 7.94 seconds)916gitlab # [ 7.312188] logrotate[581]: switching euid from 0 to 165 and egid from 0 to 165 (pid 581)917gitlab # [ 7.313175] logrotate[581]: considering log /var/gitlab/state/log/*.log918gitlab # [ 7.313967] logrotate[581]: log /var/gitlab/state/log/*.log does not exist -- skipping919gitlab # [ 7.314936] logrotate[581]: Creating new state920gitlab # [ 7.315561] logrotate[581]: switching euid from 165 to 0 and egid from 165 to 0 (pid 581)921gitlab # [ 7.316558] logrotate[581]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed922gitlab # [ 7.318065] logrotate[581]: switching euid from 0 to 60 and egid from 0 to 60 (pid 581)923gitlab # [ 7.319033] logrotate[581]: considering log /var/log/nginx/*.log924gitlab # [ 7.319812] logrotate[581]: log /var/log/nginx/*.log does not exist -- skipping925gitlab # [ 7.321019] logrotate[581]: Creating new state926gitlab # [ 7.321678] logrotate[581]: not running postrotate script, since no logs were rotated927gitlab # [ 7.322738] logrotate[581]: switching euid from 60 to 0 and egid from 60 to 0 (pid 581)928gitlab # [ 7.323990] systemd[1]: Starting resolvconf update...929gitlab # [ 7.325319] nsncd[582]: Sep 14 09:42:55.532 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"930gitlab # [ 7.327939] systemd[1]: Finished Logrotate configuration check.931gitlab # [ 7.329027] systemd[1]: Finished Post-Boot Actions.932gitlab # [ 7.330363] systemd[1]: Started Name Service Cache Daemon (nsncd).933gitlab # [ 7.331498] systemd[1]: Reached target Host and Network Name Lookups.934gitlab # [ 7.332630] systemd[1]: Reached target User and Group Name Lookups.935gitlab # [ 7.333682] systemd[1]: Starting User Login Management...936gitlab # [ 7.334489] systemd[1]: Finished Import lastlog data into lastlog2 database.937gitlab # [ 7.367542] systemd-logind[609]: New seat seat0.938gitlab # [ 7.371423] systemd-logind[609]: Watching system buttons on /dev/input/event2 (Power Button)939gitlab # [ 7.372147] systemd-logind[609]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)940gitlab # [ 7.372874] systemd-logind[609]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)941gitlab # [ 7.374237] systemd[1]: Started User Login Management.942gitlab # [ 7.374797] systemd[1]: Starting linger-users.service...943gitlab # [ 7.390324] systemd[1]: linger-users.service: Deactivated successfully.944gitlab # [ 7.390881] systemd[1]: Finished linger-users.service.945gitlab # [ 7.394320] systemd[1]: Stopped target Host and Network Name Lookups.946gitlab # [ 7.394993] systemd[1]: Stopping Host and Network Name Lookups...947gitlab # [ 7.395761] systemd[1]: Stopped target User and Group Name Lookups.948gitlab # [ 7.396234] systemd[1]: Stopping User and Group Name Lookups...949gitlab # [ 7.396750] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...950gitlab # [ 7.399927] systemd[1]: nscd.service: Deactivated successfully.951gitlab # [ 7.400677] systemd[1]: Stopped Name Service Cache Daemon (nsncd).952gitlab # [ 7.401142] systemd[1]: nscd.service: Consumed 27ms CPU time over 134ms wall clock time, 7.6M memory peak, 5.5M read from disk.953gitlab # [ 7.406940] systemd[1]: Starting Name Service Cache Daemon (nsncd)...954gitlab # [ 7.424359] systemd[1]: Started Name Service Cache Daemon (nsncd).955gitlab # [ 7.424930] nsncd[678]: Sep 14 09:42:55.649 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"956gitlab # [ 7.425777] systemd[1]: Finished resolvconf update.957gitlab # [ 7.428076] systemd[1]: Reached target Preparation for Network.958gitlab # [ 7.428456] systemd[1]: Reached target Host and Network Name Lookups.959gitlab # [ 7.428948] systemd[1]: Reached target User and Group Name Lookups.960gitlab # [ 7.431040] systemd[1]: Starting DHCP Client...961gitlab # [ 7.434080] systemd[1]: Starting Address configuration of eth1...962gitlab # [ 7.437900] systemd[1]: Starting Extra networking commands....963gitlab # [ 7.458630] network-addresses-eth1-start[699]: adding address 192.168.1.1/24... done964gitlab # [ 7.463149] network-addresses-eth1-start[699]: adding address 2001:db8:1::1/64... done965gitlab # [ 7.469715] systemd[1]: Finished Address configuration of eth1.966gitlab # [ 7.511430] systemd[1]: Finished Extra networking commands..967gitlab # [ 7.512200] systemd[1]: Reached target Network.968gitlab # [ 7.515453] systemd[1]: Starting gitlab-workhorse.service...969gitlab # [ 7.516564] systemd[1]: Starting Nginx Web Server...970gitlab # [ 7.521474] systemd[1]: Starting PostgreSQL Server...971gitlab # [ 7.522653] dhcpcd[715]: dhcpcd-10.3.2 starting972gitlab # [ 7.523487] systemd[1]: Starting Redis Server - redis-gitlab...973gitlab # [ 7.524873] dhcpcd[768]: dev: loaded udev974gitlab # [ 7.527455] systemd[1]: Starting Permit User Sessions...975gitlab # [ 7.673993] 8021q: 802.1Q VLAN Support v1.8976gitlab # [ 7.674650] 8021q: adding VLAN 0 to HW filter on device eth1977gitlab # [ 7.546788] systemd[1]: Finished Permit User Sessions.978gitlab # [ 7.552222] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.979gitlab # [ 7.555953] systemd[1]: Started Getty on tty1.980gitlab # [ 7.556295] systemd[1]: Reached target Login Prompts.981gitlab # [ 7.769426] cfg80211: Loading compiled-in X.509 certificates for regulatory database982gitlab # [ 7.775382] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'983gitlab # [ 7.776691] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'984gitlab # [ 7.780419] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2985gitlab # [ 7.781896] cfg80211: failed to load regulatory.db986gitlab # [ 7.650974] nginx-pre-start[787]: nginx: the configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf syntax is ok987gitlab # [ 7.651532] nginx-pre-start[787]: nginx: configuration file /nix/store/ahhadigcx1wjmb1izvs0lkn856wz7zi5-nginx.conf test is successful988gitlab # [ 7.656256] systemd[1]: Started Nginx Web Server.989gitlab # [ 7.813725] 8021q: adding VLAN 0 to HW filter on device eth0990gitlab # [ 7.675167] dhcpcd[768]: eth0: waiting for carrier991gitlab # [ 7.675535] dhcpcd[768]: eth0: carrier acquired992gitlab # [ 7.679372] dhcpcd[768]: DUID 00:01:00:01:32:3a:7e:1f:52:54:00:12:34:56993gitlab # [ 7.680468] dhcpcd[768]: eth0: IAID 00:12:34:56994gitlab # [ 7.681256] dhcpcd[768]: eth0: adding address fe80::5054:ff:fe12:3456995gitlab # [ 7.683882] redis-server[789]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.996gitlab # [ 7.686406] redis-server[789]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo997gitlab # [ 7.687735] redis-server[789]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=789, just started998gitlab # [ 7.689672] systemd[1]: Started Redis Server - redis-gitlab.999gitlab # [ 7.691081] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres".1000gitlab # [ 7.693194] postgresql-pre-start[791]: This user must also own the server process.1001gitlab # [ 7.694488] redis-server[789]: Configuration loaded1002gitlab # [ 7.695400] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8".1003gitlab # [ 7.696794] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8".1004gitlab # [ 7.698129] postgresql-pre-start[791]: The default text search configuration will be set to "english".1005gitlab # [ 7.699635] postgresql-pre-start[791]: Data page checksums are enabled.1006gitlab # [ 7.700719] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok1007gitlab # [ 7.702331] postgresql-pre-start[791]: creating subdirectories ... ok1008gitlab # [ 7.703392] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix1009gitlab # [ 7.704657] redis[789]: monotonic clock: POSIX clock_gettime1010gitlab # [ 7.705712] redis[789]: Running mode=standalone, port=0.1011gitlab # [ 7.706895] redis[789]: Server initialized1012gitlab # [ 7.707828] redis[789]: Ready to accept connections unix1013gitlab # [ 7.709060] redis[789]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1014gitlab # [ 7.723651] postgresql-pre-start[791]: selecting default "max_connections" ... 1001015gitlab # [ 7.766978] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB1016gitlab # [ 8.004699] systemd[1]: Started gitlab-workhorse.service.1017gitlab # [ 8.151460] postgresql-pre-start[791]: selecting default time zone ... UTC1018gitlab # [ 8.154029] postgresql-pre-start[791]: creating configuration files ... ok1019gitlab # [ 8.176175] gitlab-workhorse[824]: time="2026-09-14T09:42:56Z" level=info msg=Starting build_time=19700101.000000 version=19.0.41020gitlab # [ 8.176813] gitlab-workhorse[824]: time="2026-09-14T09:42:56Z" level=info msg="Using redis/go-redis"1021gitlab # [ 8.177852] gitlab-workhorse[824]: time="2026-09-14T09:42:56Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1022gitlab # [ 8.316250] postgresql-pre-start[791]: running bootstrap script ... ok1023gitlab # [ 8.719410] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok1024gitlab # [ 8.951199] postgresql-pre-start[791]: syncing data to disk ... ok1025gitlab # [ 8.951916] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections1026gitlab # [ 8.952326] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1027gitlab # [ 8.953140] postgresql-pre-start[791]: Success. You can now start the database server using:1028gitlab # [ 8.953871] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start1029gitlab # [ 9.061415] postgres[849]: [849] LOG: starting PostgreSQL 18.4 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit1030gitlab # [ 9.063355] postgres[849]: [849] LOG: listening on IPv6 address "::1", port 54321031gitlab # [ 9.064067] postgres[849]: [849] LOG: listening on IPv4 address "127.0.0.1", port 54321032gitlab # [ 9.069981] postgres[849]: [849] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1033gitlab # [ 9.085150] postgres[858]: [858] LOG: database system was shut down at 2026-09-14 09:42:56 GMT1034gitlab # [ 9.099918] postgres[849]: [849] LOG: database system is ready to accept connections1035gitlab # [ 9.108420] systemd[1]: Started PostgreSQL Server.1036gitlab # [ 9.110475] systemd[1]: Starting PostgreSQL Setup Scripts...1037gitlab # [ 9.342805] postgresql-setup-start[871]: CREATE DATABASE1038gitlab # [ 9.371465] postgresql-setup-start[879]: CREATE ROLE1039gitlab # [ 9.375346] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[874]: mkdir -p /var/gitlab/state/home/.ssh: OK1040gitlab # [ 9.377053] prszvjpp8qfjqrb5rqcxg3jlzg7rbbr1-gitlab-config[874]: chmod 700 /var/gitlab/state/home/.ssh: OK1041gitlab # [ 9.386183] postgresql-setup-start[881]: ALTER DATABASE1042gitlab # [ 9.406997] postgresql-setup-start[892]: CREATE ROLE1043gitlab # [ 9.409982] systemd[1]: Finished PostgreSQL Setup Scripts.1044gitlab # [ 9.410577] systemd[1]: Reached target PostgreSQL.1045gitlab # [ 9.412160] systemd[1]: Starting gitlab-postgresql.service...1046gitlab # [ 9.433605] systemd[1]: Finished gitlab-config.service.1047gitlab # [ 9.437169] systemd[1]: Started gitaly.service.1048gitlab # [ 9.439875] systemd[1]: Starting gitlab-db-config.service...1049gitlab # [ 9.504412] gitlab-postgresql-start[917]: CREATE DATABASE1050gitlab # [ 9.554377] gitlab-postgresql-start[924]: CREATE EXTENSION1051gitlab # [ 9.567396] dhcpcd[768]: eth0: soliciting an IPv6 router1052gitlab # [ 9.568735] dhcpcd[768]: eth0: Router Advertisement from fe80::21053gitlab # [ 9.569743] dhcpcd[768]: eth0: adding address fec0::5054:ff:fe12:3456/641054gitlab # [ 9.571738] dhcpcd[768]: eth0: adding route to fec0::/641055gitlab # [ 9.572679] dhcpcd[768]: eth0: adding default route via fe80::21056gitlab # [ 9.582956] dhcpcd[768]: eth0: soliciting a DHCP lease1057gitlab # [ 9.734586] NET: Registered PF_PACKET protocol family1058gitlab # [ 9.601785] dhcpcd[768]: eth0: offered 10.0.2.15 from 10.0.2.21059gitlab # [ 9.608420] dhcpcd[768]: eth0: probing address 10.0.2.15/241060gitlab # [ 9.632943] gitlab-postgresql-start[926]: CREATE EXTENSION1061gitlab # [ 9.635341] systemd[1]: Finished gitlab-postgresql.service.1062gitlab # [ 9.927895] gitaly[914]: time="2026-09-14T09:42:58.153Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/ymnlr20kjfmhkzg7i9hp25h3ii8qnn0d-gitaly.toml' and fix the errors that are printed." pid=9141063gitlab # [ 9.928709] gitaly[914]: time="2026-09-14T09:42:58.153Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=9141064gitlab # [ 9.929722] gitaly[914]: time="2026-09-14T09:42:58.153Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=9141065gitlab # [ 9.933173] gitaly[914]: time="2026-09-14T09:42:58.153Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=9141066gitlab # [ 9.933920] gitaly[914]: time="2026-09-14T09:42:58.153Z" level=info msg="Starting Gitaly" pid=914 version=1067gitlab # [ 10.081518] gitaly[914]: time="2026-09-14T09:42:58.307Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=153 pid=9141068gitlab # [ 10.081858] gitaly[914]: time="2026-09-14T09:42:58.308Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=9141069gitlab # [ 10.082633] gitaly[914]: time="2026-09-14T09:42:58.308Z" level=info msg="finished initializing command factory" duration_ms=0 pid=9141070gitlab # [ 10.083197] gitaly[914]: time="2026-09-14T09:42:58.308Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-914/git-exec-4074529041.d/git pid=9141071gitlab # [ 10.088323] gitaly[914]: time="2026-09-14T09:42:58.314Z" level=info msg="finished detecting git version" duration_ms=6 pid=9141072gitlab # [ 10.088843] gitaly[914]: time="2026-09-14T09:42:58.314Z" level=info msg="using Git version" pid=914 version=2.53.g1073gitlab # [ 10.089460] gitaly[914]: time="2026-09-14T09:42:58.315Z" level=info msg="clearing disk cache object folder" pid=914 storage=default1074gitlab # [ 10.089878] gitaly[914]: time="2026-09-14T09:42:58.315Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1098372353 pid=914 storage=default1075gitlab # [ 10.090970] gitaly[914]: time="2026-09-14T09:42:58.315Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1098372353 pid=914 storage=default1076gitlab # [ 10.091823] gitaly[914]: time="2026-09-14T09:42:58.315Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9141077gitlab # [ 10.092911] gitaly[914]: time="2026-09-14T09:42:58.315Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9141078gitlab # [ 10.093786] gitaly[914]: time="2026-09-14T09:42:58.319Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1098372353 clear_duration_ms=0 pid=914 storage=default1079gitlab # [ 10.144904] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9141080gitlab # [ 10.147322] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=914 schema=unix1081gitlab # [ 10.147752] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="finished tempdir cleaner walk" pid=914 storage=default time_ms=01082gitlab # [ 10.148632] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="listening at address" address=/run/gitaly/gitaly-914/sock.d/intern pid=914 schema=unix1083gitlab # [ 10.149570] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="counting repositories" pid=9141084gitlab # [ 10.150286] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="starting to count repositories" pid=914 storage_path=/var/gitlab/state/repositories1085gitlab # [ 10.150750] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=914 storage_path=/var/gitlab/state/repositories1086gitlab # [ 10.151486] gitaly[914]: time="2026-09-14T09:42:58.371Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9141087gitlab # [ 10.152092] gitaly[914]: time="2026-09-14T09:42:58.373Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9141088gitlab # [ 10.152804] gitaly[914]: time="2026-09-14T09:42:58.373Z" level=info msg="Started Gitaly" duration_ms=219 pid=9141089gitlab # [ 10.153459] gitaly[914]: time="2026-09-14T09:42:58.373Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9141090gitlab # [ 10.154123] gitaly[914]: time="2026-09-14T09:42:58.374Z" level=info msg="maintenance: daily scheduled" pid=914 scheduled="2026-09-14 12:00:00 +0000 UTC"1091gitlab # [ 10.802771] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1092gitlab # [ 10.803864] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1093gitlab # [ 10.838521] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1094gitlab # [ 12.047312] gitaly[914]: time="2026-09-14T09:43:00.272Z" level=info msg="License database preloaded" duration_ms=2118 pid=9141095gitlab # [ 14.472863] dhcpcd[768]: eth0: leased 10.0.2.15 for 86400 seconds1096gitlab # [ 14.473731] dhcpcd[768]: eth0: adding route to 10.0.2.0/241097gitlab # [ 14.475698] dhcpcd[768]: eth0: adding default route via 10.0.2.21098gitlab # [ 14.581931] systemd[1]: Started DHCP Client.1099gitlab # [ 14.583870] systemd[1]: Reached target Network is Online.1100gitlab # [ 40.980806] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[920]: W, [2026-09-14T09:43:29.206356 #920] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1101gitlab # [ 43.183954] postgres[1309]: [1309] ERROR: relation "feature_gates" does not exist at character 5231102gitlab # [ 43.184359] postgres[1309]: [1309] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1103gitlab # [ 43.185883] postgres[1309]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1104gitlab # [ 43.188144] postgres[1309]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1105gitlab # [ 43.189713] postgres[1309]: attidentity AS identity,1106gitlab # [ 43.191443] postgres[1309]: attgenerated as attgenerated1107gitlab # [ 43.193333] postgres[1309]: FROM pg_attribute a1108gitlab # [ 43.195267] postgres[1309]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1109gitlab # [ 43.197138] postgres[1309]: LEFT JOIN pg_type t ON a.atttypid = t.oid1110gitlab # [ 43.198988] postgres[1309]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1111gitlab # [ 43.201227] postgres[1309]: WHERE a.attrelid = '"feature_gates"'::regclass1112gitlab # [ 43.203135] postgres[1309]: AND a.attnum > 0 AND NOT a.attisdropped1113gitlab # [ 43.204997] postgres[1309]: ORDER BY a.attnum1114gitlab # [ 43.206908] postgres[1309]:1115gitlab # [ 46.645269] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1116gitlab # [ 46.645745] j52kjsy7niw11krx8yhb7ipfwm07y66n-gitlab-db-config[1351]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1117gitlab # [ 48.246881] gitlab-workhorse[824]: time="2026-09-14T09:43:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1118gitlab # [ 58.251865] gitlab-workhorse[824]: time="2026-09-14T09:43:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1119gitlab # [ 61.927232] postgres[1418]: [1418] ERROR: relation "table_without_models" does not exist1120gitlab # [ 61.930253] postgres[1418]: [1418] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1121gitlab # [ 68.254624] gitlab-workhorse[824]: time="2026-09-14T09:43:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1122gitlab # [ 74.848678] systemd[1]: Finished gitlab-db-config.service.1123gitlab # [ 74.851561] systemd[1]: Started gitlab-sidekiq.service.1124gitlab # [ 74.854223] systemd[1]: Starting gitlab.service...1125gitlab # [ 75.229351] bundle[1603]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1126gitlab # [ 75.230146] bundle[1603]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1127gitlab # [ 75.234361] bundle[1603]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1128gitlab # [ 78.011360] sidekiq-cluster[1602]: {"severity":"INFO","time":"2026-09-14T09:44:06.220Z","message":"Starting cluster with 1 processes"}1129gitlab # [ 78.228114] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.431Z","pid":1603,"message":"* Enabling systemd notification integration"}1130gitlab # [ 78.228963] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.453Z","pid":1603,"message":"Puma starting in cluster mode..."}1131gitlab # [ 78.229815] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.453Z","pid":1603,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1132gitlab # [ 78.230781] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.453Z","pid":1603,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1133gitlab # [ 78.231787] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.453Z","pid":1603,"message":"* Min threads: 0"}1134gitlab # [ 78.232685] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.453Z","pid":1603,"message":"* Max threads: 4"}1135gitlab # [ 78.233610] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.453Z","pid":1603,"message":"* Environment: production"}1136gitlab # [ 78.234284] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.454Z","pid":1603,"message":"* Master PID: 1603"}1137gitlab # [ 78.235049] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.454Z","pid":1603,"message":"* Workers: 2"}1138gitlab # [ 78.235694] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.454Z","pid":1603,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1139gitlab # [ 78.236557] bundle[1603]: {"timestamp":"2026-09-14T09:44:06.454Z","pid":1603,"message":"* Preloading application"}1140gitlab # [ 78.262673] gitlab-workhorse[824]: time="2026-09-14T09:44:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1141gitlab # [ 88.271963] gitlab-workhorse[824]: time="2026-09-14T09:44:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1142gitlab # [ 98.281911] gitlab-workhorse[824]: time="2026-09-14T09:44:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143gitlab # [ 101.421643] bundle[1603]: W, [2026-09-14T09:44:29.647270 #1603] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1144gitlab # [ 103.726527] sidekiq-cluster[1633]: 2026-09-14T09:44:31.952Z pid=1633 tid=wjt INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1633, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>438767616}1145gitlab # [ 103.912936] sidekiq-cluster[1633]: W, [2026-09-14T09:44:32.139093 #1633] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1146gitlab # [ 103.996089] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:32.221Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1147gitlab # [ 106.003639] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.229Z","message":"GitLab reliable fetch activated!"}1148gitlab # [ 106.004734] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.229Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1149gitlab # [ 106.032373] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.258Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1150gitlab # [ 106.036893] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.263Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1151gitlab # [ 106.041495] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.267Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1152gitlab # [ 106.045828] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.272Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1153gitlab # [ 106.050542] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.276Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1154gitlab # [ 106.054850] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.281Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 106.059164] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.285Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1156gitlab # [ 106.063081] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.289Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1157gitlab # [ 106.066986] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.293Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1158gitlab # [ 106.070878] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.297Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1159gitlab # [ 106.074922] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.301Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1160gitlab # [ 106.079357] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.305Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1161gitlab # [ 106.083417] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.309Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1162gitlab # [ 106.087591] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.313Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1163gitlab # [ 106.091662] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.318Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1164gitlab # [ 106.095793] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.322Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1165gitlab # [ 106.100380] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.326Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1166gitlab # [ 106.106427] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.332Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1167gitlab # [ 106.113639] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.339Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1168gitlab # [ 106.119876] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.346Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1169gitlab # [ 106.125357] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.351Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1170gitlab # [ 106.129947] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.356Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1171gitlab # [ 106.135762] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.362Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1172gitlab # [ 106.141722] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.368Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1173gitlab # [ 106.147461] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.373Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1174gitlab # [ 106.153981] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.380Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1175gitlab # [ 106.160424] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.386Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1176gitlab # [ 106.165233] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.391Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1177gitlab # [ 106.171811] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.398Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1178gitlab # [ 106.178258] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.404Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1179gitlab # [ 106.183630] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.409Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1180gitlab # [ 106.190084] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.416Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1181gitlab # [ 106.195969] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.422Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1182gitlab # [ 106.205080] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.430Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1183gitlab # [ 106.211168] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.437Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1184gitlab # [ 106.215312] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.441Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1185gitlab # [ 106.220590] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.446Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1186gitlab # [ 106.225843] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.451Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1187gitlab # [ 106.231440] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.457Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1188gitlab # [ 106.236423] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.462Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1189gitlab # [ 106.241387] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.467Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1190gitlab # [ 106.244803] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.471Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1191gitlab # [ 106.247769] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.474Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1192gitlab # [ 106.250583] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.477Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1193gitlab # [ 106.254058] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.480Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1194gitlab # [ 106.259435] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.485Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1195gitlab # [ 106.264150] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.490Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1196gitlab # [ 106.268972] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.495Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1197gitlab # [ 106.289733] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.515Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1198gitlab # [ 106.297832] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.524Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1199gitlab # [ 106.304679] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.531Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1200gitlab # [ 106.354626] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.580Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1201gitlab # [ 106.371248] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.597Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1202gitlab # [ 106.374466] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.600Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1203gitlab # [ 106.378740] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.605Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1204gitlab # [ 106.382880] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.609Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1205gitlab # [ 106.387185] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.613Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1206gitlab # [ 106.391342] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.617Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1207gitlab # [ 106.395808] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.622Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1208gitlab # [ 106.399355] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.625Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1209gitlab # [ 106.402437] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.628Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1210gitlab # [ 106.405545] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.631Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1211gitlab # [ 106.409969] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.636Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1212gitlab # [ 106.413807] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.640Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1213gitlab # [ 106.417903] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.644Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1214gitlab # [ 106.422389] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.648Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1215gitlab # [ 106.427950] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.654Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1216gitlab # [ 106.430867] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.657Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1217gitlab # [ 106.433312] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.659Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1218gitlab # [ 106.435741] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.662Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1219gitlab # [ 106.438786] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.665Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1220gitlab # [ 106.441219] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.667Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1221gitlab # [ 106.443383] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.669Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1222gitlab # [ 106.445928] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.672Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1223gitlab # [ 106.448297] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.674Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1224gitlab # [ 106.451283] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.677Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1225gitlab # [ 106.453552] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.680Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1226gitlab # [ 106.456132] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.682Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1227gitlab # [ 106.458337] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.684Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1228gitlab # [ 106.460921] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.687Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1229gitlab # [ 106.463354] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.689Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1230gitlab # [ 106.465885] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.691Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1231gitlab # [ 106.468891] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.695Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1232gitlab # [ 106.471597] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.698Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1233gitlab # [ 106.473237] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.699Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1234gitlab # [ 106.475199] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.701Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1235gitlab # [ 106.478126] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.704Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1236gitlab # [ 106.479794] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.706Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1237gitlab # [ 106.482708] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.709Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1238gitlab # [ 106.484364] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.710Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1239gitlab # [ 106.486808] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.713Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1240gitlab # [ 106.488393] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.714Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1241gitlab # [ 106.490775] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.717Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1242gitlab # [ 106.493064] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.719Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1243gitlab # [ 106.495960] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.722Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1244gitlab # [ 106.498190] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.724Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1245gitlab # [ 106.500181] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.726Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1246gitlab # [ 106.501912] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.728Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1247gitlab # [ 106.511268] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.737Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1248gitlab # [ 106.512776] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.739Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1249gitlab # [ 106.514617] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.741Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1250gitlab # [ 106.518048] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.744Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1251gitlab # [ 106.520326] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.746Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1252gitlab # [ 106.522347] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.748Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1253gitlab # [ 106.524796] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.751Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1254gitlab # [ 106.526368] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.752Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1255gitlab # [ 106.528405] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.754Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1256gitlab # [ 106.531253] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.757Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1257gitlab # [ 106.532913] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:44:34.759Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1258gitlab # [ 108.290071] gitlab-workhorse[824]: time="2026-09-14T09:44:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1259gitlab # [ 118.291916] gitlab-workhorse[824]: time="2026-09-14T09:44:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1260gitlab # [ 128.292725] gitlab-workhorse[824]: time="2026-09-14T09:44:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1261gitlab # [ 129.768818] postgres[2080]: [2080] ERROR: relation "table_without_models" does not exist1262gitlab # [ 129.769253] postgres[2080]: [2080] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1263gitlab # [ 130.022834] postgres[2091]: [2091] ERROR: relation "table_without_models" does not exist1264gitlab # [ 130.023046] postgres[2091]: [2091] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1265gitlab # [ 132.162968] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:00.385Z","message":"Booted Rails 7.2.3.1 application in production environment"}1266gitlab # [ 132.163167] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:00.388Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1267gitlab # [ 132.163958] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:00.388Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1268gitlab # [ 132.174827] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:00.388Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1269gitlab # [ 132.176840] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:00.403Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1270gitlab # [ 132.704477] bundle[1603]: {"timestamp":"2026-09-14T09:45:00.930Z","pid":1603,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1271gitlab # [ 132.704798] bundle[1603]: {"timestamp":"2026-09-14T09:45:00.931Z","pid":1603,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1272gitlab # [ 132.705621] bundle[1603]: {"timestamp":"2026-09-14T09:45:00.932Z","pid":1603,"message":"! #\u003cThread:0x0000733e462de680 /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/0pw9q4cx4pc2icd2n81q1c3zi7y56z3a-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1273gitlab # [ 132.707312] bundle[1603]: {"timestamp":"2026-09-14T09:45:00.933Z","pid":1603,"message":"! #\u003cThread:0x0000733e4656e918 /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/zyib4fdxd0zl63b2nm6163j5jb69nbrk-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1274gitlab # [ 132.708812] bundle[1603]: {"timestamp":"2026-09-14T09:45:00.933Z","pid":1603,"message":"Use Ctrl-C to stop"}1275gitlab # [ 132.712589] bundle[1603]: {"timestamp":"2026-09-14T09:45:00.933Z","pid":1603,"message":"Sending status to systemd every 1.0 sec"}1276gitlab # [ 133.086477] bundle[1603]: {"timestamp":"2026-09-14T09:45:01.312Z","pid":1603,"message":"- Worker 0 (PID: 2166) booted in 0.32s, phase: 0"}1277gitlab # [ 133.103607] bundle[1603]: {"timestamp":"2026-09-14T09:45:01.329Z","pid":1603,"message":"- Worker 1 (PID: 2170) booted in 0.32s, phase: 0"}1278gitlab # [ 133.110622] systemd[1]: Started gitlab.service.1279gitlab # [ 133.110812] systemd[1]: Reached target Common target for all GitLab services..1280gitlab # [ 133.114254] systemd[1]: Starting setup-gitlab.service...1281gitlab # [ 133.130881] setup-gitlab-start[2194]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1282gitlab # [ 133.631898] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:01.857Z","message":"Cleaning working queues"}1283gitlab # [ 133.635646] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:01.859Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"be06dddc7b91d871c78d8abe","created_at":"2026-09-14T09:44:02.746Z","trace_propagation_headers":{"sentry-trace":"17e7f26af44a4254a7bb4f1311cb5e73-49349ee6431e4570","baggage":"sentry-trace_id=17e7f26af44a4254a7bb4f1311cb5e73,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"7ae0424d4dace51cb7fe621df65f50ed","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T09:44:02.754Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-be06dddc7b91d871c78d8abe: start","job_status":"start","queue_duration_s":59.104919,"scheduling_latency_s":59.105062}1284gitlab # [ 133.796806] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:02.022Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"be06dddc7b91d871c78d8abe","created_at":"2026-09-14T09:44:02.746Z","trace_propagation_headers":{"sentry-trace":"17e7f26af44a4254a7bb4f1311cb5e73-49349ee6431e4570","baggage":"sentry-trace_id=17e7f26af44a4254a7bb4f1311cb5e73,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"7ae0424d4dace51cb7fe621df65f50ed","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T09:44:02.754Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-be06dddc7b91d871c78d8abe: done: 0.16327 sec","job_status":"done","queue_duration_s":59.104919,"scheduling_latency_s":59.105062,"redis_calls":26,"redis_duration_s":0.007432,"redis_read_bytes":914,"redis_write_bytes":2887,"redis_feature_flag_calls":15,"redis_feature_flag_duration_s":0.003807,"redis_feature_flag_read_bytes":904,"redis_feature_flag_write_bytes":1640,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002275,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00135,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.084416315,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.16327,"completed_at":"2026-09-14T09:45:02.022Z","load_balancing_strategy":"primary","db_duration_s":0.047411,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1285gitlab # [ 135.314648] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:45:03 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 21581286gitlab # [ 135.320107] setup-gitlab-start[2194]: + TOKEN=nixbot-test-token-of-20-chars1287gitlab # [ 135.322516] setup-gitlab-start[2194]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1288gitlab # [ 135.334517] runuser[2219]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1289gitlab # [ 135.694375] setup-gitlab-start[2220]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1290gitlab # [ 135.699290] setup-gitlab-start[2220]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1291gitlab # [ 135.704134] setup-gitlab-start[2220]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1292gitlab # [ 136.270913] setup-gitlab-start[2220]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1293gitlab # [ 136.276092] setup-gitlab-start[2220]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1294gitlab # [ 136.280774] setup-gitlab-start[2220]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1295gitlab # [ 146.259982] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"08a49d7f7cade6beccdeb3ad","created_at":"2026-09-14T09:45:14.445Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03810fb977d3e4256ad0c668e8bd6846","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.481Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-08a49d7f7cade6beccdeb3ad: start","job_status":"start","queue_duration_s":0.003035,"scheduling_latency_s":0.00311}1296gitlab # [ 146.332330] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.558Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1297gitlab # [ 146.355714] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"08a49d7f7cade6beccdeb3ad","created_at":"2026-09-14T09:45:14.445Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03810fb977d3e4256ad0c668e8bd6846","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.481Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-08a49d7f7cade6beccdeb3ad: done: 0.096484 sec","job_status":"done","queue_duration_s":0.003035,"scheduling_latency_s":0.00311,"redis_calls":10,"redis_duration_s":0.01621,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001303,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003209,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.002684419,"duration_s":0.096484,"completed_at":"2026-09-14T09:45:14.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02131,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 146.400157] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8d5e65be033a06a02d4efc9c","created_at":"2026-09-14T09:45:14.513Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79411c4f97a409d6152a756869066ecc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.525Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8d5e65be033a06a02d4efc9c: start","job_status":"start","queue_duration_s":0.058447,"scheduling_latency_s":0.058487}1299gitlab # [ 146.412769] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"8d5e65be033a06a02d4efc9c","created_at":"2026-09-14T09:45:14.513Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79411c4f97a409d6152a756869066ecc","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.525Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-8d5e65be033a06a02d4efc9c: done: 0.037874 sec","job_status":"done","queue_duration_s":0.058447,"scheduling_latency_s":0.058487,"redis_calls":10,"redis_duration_s":0.003416,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000460952,"duration_s":0.037874,"completed_at":"2026-09-14T09:45:14.621Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 146.450397] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c9e93c54be6abf7f678c5738","created_at":"2026-09-14T09:45:14.556Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea0e2af0878034fe876f4d94b87c077a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.620Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c9e93c54be6abf7f678c5738: start","job_status":"start","queue_duration_s":0.002503,"scheduling_latency_s":0.002517}1301gitlab # [ 146.466700] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c9e93c54be6abf7f678c5738","created_at":"2026-09-14T09:45:14.556Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea0e2af0878034fe876f4d94b87c077a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.620Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c9e93c54be6abf7f678c5738: done: 0.069522 sec","job_status":"done","queue_duration_s":0.002503,"scheduling_latency_s":0.002517,"redis_calls":10,"redis_duration_s":0.0038150000000000002,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000934,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000329372,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.069522,"completed_at":"2026-09-14T09:45:14.692Z","load_balancing_strategy":"primary","db_duration_s":0.044062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 146.509797] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.735Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"e3eeb2ecf183136b008d9cfa","created_at":"2026-09-14T09:45:14.628Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58e5a7983ba3bd30058a9fe2e3d0fb8c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.637Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-e3eeb2ecf183136b008d9cfa: start","job_status":"start","queue_duration_s":0.098554,"scheduling_latency_s":0.098594}1303gitlab # [ 146.643317] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"e3eeb2ecf183136b008d9cfa","created_at":"2026-09-14T09:45:14.628Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58e5a7983ba3bd30058a9fe2e3d0fb8c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.637Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-e3eeb2ecf183136b008d9cfa: done: 0.13302 sec","job_status":"done","queue_duration_s":0.098554,"scheduling_latency_s":0.098594,"redis_calls":17,"redis_duration_s":0.023717,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.010925,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001305,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002924,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00151779,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.13302,"completed_at":"2026-09-14T09:45:14.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 146.710567] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8291b42aab15953368a2ab88","created_at":"2026-09-14T09:45:14.639Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b80d3ac012f931c3b5d4fe06e9752a81","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.646Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8291b42aab15953368a2ab88: start","job_status":"start","queue_duration_s":0.238998,"scheduling_latency_s":0.239052}1305gitlab # [ 146.769939] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:14.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8291b42aab15953368a2ab88","created_at":"2026-09-14T09:45:14.639Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b80d3ac012f931c3b5d4fe06e9752a81","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.646Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8291b42aab15953368a2ab88: done: 0.110525 sec","job_status":"done","queue_duration_s":0.238998,"scheduling_latency_s":0.239052,"redis_calls":12,"redis_duration_s":0.014499,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005383,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006767,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.006062782,"exclusive_lock_hold_duration_s":0.036673376,"duration_s":0.110525,"completed_at":"2026-09-14T09:45:14.995Z","load_balancing_strategy":"primary","db_duration_s":0.040914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 146.799895] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"29cca94c879518d323b2d91c","created_at":"2026-09-14T09:45:14.666Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78a201527d50a0e4922a319c11a292ac","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.669Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-29cca94c879518d323b2d91c: start","job_status":"start","queue_duration_s":0.330992,"scheduling_latency_s":0.331032}1307gitlab # [ 146.853282] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"29cca94c879518d323b2d91c","created_at":"2026-09-14T09:45:14.666Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78a201527d50a0e4922a319c11a292ac","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.669Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-29cca94c879518d323b2d91c: done: 0.07856 sec","job_status":"done","queue_duration_s":0.330992,"scheduling_latency_s":0.331032,"redis_calls":12,"redis_duration_s":0.032821,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0204,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.002985016,"exclusive_lock_hold_duration_s":0.005661055,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.07856,"completed_at":"2026-09-14T09:45:15.079Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 146.874391] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"03d90784007b7ed3809ce9ff","created_at":"2026-09-14T09:45:14.674Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30c674c16ffeb69266d8626e60995b0f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.677Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-03d90784007b7ed3809ce9ff: start","job_status":"start","queue_duration_s":0.406263,"scheduling_latency_s":0.406286}1309gitlab # [ 146.898826] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.125Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"03d90784007b7ed3809ce9ff","created_at":"2026-09-14T09:45:14.674Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30c674c16ffeb69266d8626e60995b0f","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.677Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-03d90784007b7ed3809ce9ff: done: 0.041375 sec","job_status":"done","queue_duration_s":0.406263,"scheduling_latency_s":0.406286,"redis_calls":10,"redis_duration_s":0.007995,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001919,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004037,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017354,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000371277,"duration_s":0.041375,"completed_at":"2026-09-14T09:45:15.124Z","load_balancing_strategy":"primary","db_duration_s":0.012347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 146.900947] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dcdf526a46602a18635e29c4","created_at":"2026-09-14T09:45:14.679Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73afdda308a8575d1f1b917ce57876c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.682Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dcdf526a46602a18635e29c4: start","job_status":"start","queue_duration_s":0.443739,"scheduling_latency_s":0.443752}1311gitlab # [ 146.919426] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.145Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1312gitlab # [ 146.932646] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"dcdf526a46602a18635e29c4","created_at":"2026-09-14T09:45:14.679Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73afdda308a8575d1f1b917ce57876c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.682Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-dcdf526a46602a18635e29c4: done: 0.031701 sec","job_status":"done","queue_duration_s":0.443739,"scheduling_latency_s":0.443752,"redis_calls":10,"redis_duration_s":0.001501,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225448,"duration_s":0.031701,"completed_at":"2026-09-14T09:45:15.157Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 146.976258] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.159Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a88ff9690f4641f57dcefdd4","created_at":"2026-09-14T09:45:14.685Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d796e8f2bbd1d7253983b76e2eff160","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.732Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a88ff9690f4641f57dcefdd4: start","job_status":"start","queue_duration_s":0.427751,"scheduling_latency_s":0.427765}1314gitlab # [ 147.111788] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a88ff9690f4641f57dcefdd4","created_at":"2026-09-14T09:45:14.685Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d796e8f2bbd1d7253983b76e2eff160","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.732Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a88ff9690f4641f57dcefdd4: done: 0.177712 sec","job_status":"done","queue_duration_s":0.427751,"scheduling_latency_s":0.427765,"redis_calls":14,"redis_duration_s":0.007117,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004978,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000358704,"exclusive_lock_hold_duration_s":0.15334407,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.177712,"completed_at":"2026-09-14T09:45:15.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045144,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 147.173707] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"226e4e2883d26ad731c179f8","created_at":"2026-09-14T09:45:14.774Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd8cdf714360d5379885e002ded1262f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.784Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-226e4e2883d26ad731c179f8: start","job_status":"start","queue_duration_s":0.614809,"scheduling_latency_s":0.614847}1316gitlab # [ 147.221829] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"226e4e2883d26ad731c179f8","created_at":"2026-09-14T09:45:14.774Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd8cdf714360d5379885e002ded1262f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.784Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-226e4e2883d26ad731c179f8: done: 0.048067 sec","job_status":"done","queue_duration_s":0.614809,"scheduling_latency_s":0.614847,"redis_calls":12,"redis_duration_s":0.003257,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001129,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001526,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000450895,"duration_s":0.048067,"completed_at":"2026-09-14T09:45:15.447Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 147.262857] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9c705a0994028ba82b05ef35","created_at":"2026-09-14T09:45:14.796Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cbcd662a8000f0ef224ce1542ec003d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.810Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9c705a0994028ba82b05ef35: start","job_status":"start","queue_duration_s":0.677559,"scheduling_latency_s":0.677595}1318gitlab # [ 147.306777] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.532Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9c705a0994028ba82b05ef35","created_at":"2026-09-14T09:45:14.796Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cbcd662a8000f0ef224ce1542ec003d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.810Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9c705a0994028ba82b05ef35: done: 0.044861 sec","job_status":"done","queue_duration_s":0.677559,"scheduling_latency_s":0.677595,"redis_calls":10,"redis_duration_s":0.0032040000000000003,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000678,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001835,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000533029,"duration_s":0.044861,"completed_at":"2026-09-14T09:45:15.532Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 147.347430] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"af3d8cacb1de150203c3f634","created_at":"2026-09-14T09:45:14.825Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a11222a5568e44a5cba1b6d904981d5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:45:14.840Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-af3d8cacb1de150203c3f634: start","job_status":"start","queue_duration_s":0.732401,"scheduling_latency_s":0.732456}1320gitlab # [ 147.398155] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"af3d8cacb1de150203c3f634","created_at":"2026-09-14T09:45:14.825Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a11222a5568e44a5cba1b6d904981d5c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:45:14.840Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-af3d8cacb1de150203c3f634: done: 0.050818 sec","job_status":"done","queue_duration_s":0.732401,"scheduling_latency_s":0.732456,"redis_calls":10,"redis_duration_s":0.003473,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00067,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000708,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000600914,"duration_s":0.050818,"completed_at":"2026-09-14T09:45:15.623Z","load_balancing_strategy":"primary","db_duration_s":0.005781,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 147.436862] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1cabc5a3c4204eeb5cc6712a","created_at":"2026-09-14T09:45:14.852Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.871Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1cabc5a3c4204eeb5cc6712a: start","job_status":"start","queue_duration_s":0.791509,"scheduling_latency_s":0.791555}1322gitlab # [ 147.492067] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"1cabc5a3c4204eeb5cc6712a","created_at":"2026-09-14T09:45:14.852Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.871Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-1cabc5a3c4204eeb5cc6712a: done: 0.055197 sec","job_status":"done","queue_duration_s":0.791509,"scheduling_latency_s":0.791555,"redis_calls":19,"redis_duration_s":0.006343,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001352,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000588,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003425,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000427708,"duration_s":0.055197,"completed_at":"2026-09-14T09:45:15.717Z","load_balancing_strategy":"primary","db_duration_s":0.003202,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 147.531464] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9d97d76c7eccebc67f30ee34","created_at":"2026-09-14T09:45:14.883Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"707dc4d3f7cd80d8556cac65218c9bbd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:45:14.919Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9d97d76c7eccebc67f30ee34: start","job_status":"start","queue_duration_s":0.837668,"scheduling_latency_s":0.837706}1324gitlab # [ 147.548101] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.774Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1325gitlab # [ 147.558677] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"9d97d76c7eccebc67f30ee34","created_at":"2026-09-14T09:45:14.883Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"707dc4d3f7cd80d8556cac65218c9bbd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:45:14.919Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-9d97d76c7eccebc67f30ee34: done: 0.027005 sec","job_status":"done","queue_duration_s":0.837668,"scheduling_latency_s":0.837706,"redis_calls":10,"redis_duration_s":0.0028980000000000004,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00169,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000635,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000484978,"duration_s":0.027005,"completed_at":"2026-09-14T09:45:15.784Z","load_balancing_strategy":"primary","db_duration_s":0.00072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 147.598225] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1549dfea28e2d67848baee3d","created_at":"2026-09-14T09:45:14.929Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5086fb1c151afa9590483ddf8cb52b3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.941Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1549dfea28e2d67848baee3d: start","job_status":"start","queue_duration_s":0.882487,"scheduling_latency_s":0.882524}1327gitlab # [ 147.644734] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1549dfea28e2d67848baee3d","created_at":"2026-09-14T09:45:14.929Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5086fb1c151afa9590483ddf8cb52b3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.941Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1549dfea28e2d67848baee3d: done: 0.046217 sec","job_status":"done","queue_duration_s":0.882487,"scheduling_latency_s":0.882524,"redis_calls":13,"redis_duration_s":0.004011,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001961,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001448,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.013221792,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.046217,"completed_at":"2026-09-14T09:45:15.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003086,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1328gitlab # [ 147.687261] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:15.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ca2c444f0fe6cb2e53114c08","created_at":"2026-09-14T09:45:14.961Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6616c5f2222bc279fee3ed59277aa39f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.971Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ca2c444f0fe6cb2e53114c08: start","job_status":"start","queue_duration_s":0.941442,"scheduling_latency_s":0.941481}1329gitlab # [ 147.973776] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"ca2c444f0fe6cb2e53114c08","created_at":"2026-09-14T09:45:14.961Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6616c5f2222bc279fee3ed59277aa39f","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:14.971Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-ca2c444f0fe6cb2e53114c08: done: 0.286714 sec","job_status":"done","queue_duration_s":0.941442,"scheduling_latency_s":0.941481,"redis_calls":565,"redis_duration_s":0.094234,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000649,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.091794,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.217504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000305625,"duration_s":0.286714,"completed_at":"2026-09-14T09:45:16.199Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00068,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 148.011983] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.238Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"aec337d57526f4aa7408b962","created_at":"2026-09-14T09:45:14.996Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2a879665c8f7cb605c1b77a2d76ac08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:45:15.004Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-aec337d57526f4aa7408b962: start","job_status":"start","queue_duration_s":1.233747,"scheduling_latency_s":1.23377}1331gitlab # [ 148.032673] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.258Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1332gitlab # [ 148.041049] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"aec337d57526f4aa7408b962","created_at":"2026-09-14T09:45:14.996Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2a879665c8f7cb605c1b77a2d76ac08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:45:15.004Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-aec337d57526f4aa7408b962: done: 0.029086 sec","job_status":"done","queue_duration_s":1.233747,"scheduling_latency_s":1.23377,"redis_calls":10,"redis_duration_s":0.00429,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000328,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000248076,"duration_s":0.029086,"completed_at":"2026-09-14T09:45:16.267Z","load_balancing_strategy":"primary","db_duration_s":0.000566,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 148.078388] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ebaf3240457459848aa519ba","created_at":"2026-09-14T09:45:15.007Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a29fa3d6e40c6c7eedb8a20c9f92f43","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.017Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ebaf3240457459848aa519ba: start","job_status":"start","queue_duration_s":1.287218,"scheduling_latency_s":1.28724}1334gitlab # [ 148.104399] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.330Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1335gitlab # [ 148.116637] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ebaf3240457459848aa519ba","created_at":"2026-09-14T09:45:15.007Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a29fa3d6e40c6c7eedb8a20c9f92f43","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.017Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ebaf3240457459848aa519ba: done: 0.037812 sec","job_status":"done","queue_duration_s":1.287218,"scheduling_latency_s":1.28724,"redis_calls":10,"redis_duration_s":0.003313,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000584,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000841,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015605,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000527161,"duration_s":0.037812,"completed_at":"2026-09-14T09:45:16.342Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 148.156419] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"38498624c271d613c895dddb","created_at":"2026-09-14T09:45:15.027Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab3e50524f448c8606829aba005880c7","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.040Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-38498624c271d613c895dddb: start","job_status":"start","queue_duration_s":1.34134,"scheduling_latency_s":1.341391}1337gitlab # [ 148.198844] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"38498624c271d613c895dddb","created_at":"2026-09-14T09:45:15.027Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab3e50524f448c8606829aba005880c7","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.040Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-38498624c271d613c895dddb: done: 0.042098 sec","job_status":"done","queue_duration_s":1.34134,"scheduling_latency_s":1.341391,"redis_calls":11,"redis_duration_s":0.002761,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004224,"duration_s":0.042098,"completed_at":"2026-09-14T09:45:16.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 148.238066] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b1eba5a07ee664f10fb6cdae","created_at":"2026-09-14T09:45:15.047Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a3c68d515aeb408f1c702690f153283","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.058Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b1eba5a07ee664f10fb6cdae: start","job_status":"start","queue_duration_s":1.404838,"scheduling_latency_s":1.404879}1339gitlab # [ 148.319641] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.544Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b1eba5a07ee664f10fb6cdae","created_at":"2026-09-14T09:45:15.047Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a3c68d515aeb408f1c702690f153283","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.058Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b1eba5a07ee664f10fb6cdae: done: 0.080886 sec","job_status":"done","queue_duration_s":1.404838,"scheduling_latency_s":1.404879,"redis_calls":12,"redis_duration_s":0.00359,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000855,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032272,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000957943,"exclusive_lock_hold_duration_s":0.019355532,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.080886,"completed_at":"2026-09-14T09:45:16.544Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 148.360855] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3c4569863ed83c88da6be5cf","created_at":"2026-09-14T09:45:15.062Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bba6edce50380473b8c09bcd8defee39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.082Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3c4569863ed83c88da6be5cf: start","job_status":"start","queue_duration_s":1.504089,"scheduling_latency_s":1.504133}1341gitlab # [ 148.391610] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.617Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1342gitlab # [ 148.405914] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"3c4569863ed83c88da6be5cf","created_at":"2026-09-14T09:45:15.062Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bba6edce50380473b8c09bcd8defee39","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.082Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-3c4569863ed83c88da6be5cf: done: 0.045062 sec","job_status":"done","queue_duration_s":1.504089,"scheduling_latency_s":1.504133,"redis_calls":10,"redis_duration_s":0.004363,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000439162,"duration_s":0.045062,"completed_at":"2026-09-14T09:45:16.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 148.409628] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"71f4f170bcd294a658d3cd5d","created_at":"2026-09-14T09:45:15.092Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24fa293e247c0a5a30edbaa6b3ff9859","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.103Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-71f4f170bcd294a658d3cd5d: start","job_status":"start","queue_duration_s":1.531557,"scheduling_latency_s":1.531608}1344gitlab # [ 148.454068] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"71f4f170bcd294a658d3cd5d","created_at":"2026-09-14T09:45:15.092Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"24fa293e247c0a5a30edbaa6b3ff9859","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.103Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-71f4f170bcd294a658d3cd5d: done: 0.043901 sec","job_status":"done","queue_duration_s":1.531557,"scheduling_latency_s":1.531608,"redis_calls":11,"redis_duration_s":0.004144,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001064,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000529677,"duration_s":0.043901,"completed_at":"2026-09-14T09:45:16.679Z","load_balancing_strategy":"primary","db_duration_s":0.004385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 148.456145] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5ec0c2262c49eb8dc679eb5d","created_at":"2026-09-14T09:45:15.113Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.120Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5ec0c2262c49eb8dc679eb5d: start","job_status":"start","queue_duration_s":1.561898,"scheduling_latency_s":1.561925}1346gitlab # [ 148.580107] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5ec0c2262c49eb8dc679eb5d","created_at":"2026-09-14T09:45:15.113Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.120Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5ec0c2262c49eb8dc679eb5d: done: 0.123598 sec","job_status":"done","queue_duration_s":1.561898,"scheduling_latency_s":1.561925,"redis_calls":71,"redis_duration_s":0.010775,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001378,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000674,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008189,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.107806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000266794,"duration_s":0.123598,"completed_at":"2026-09-14T09:45:16.805Z","load_balancing_strategy":"primary","db_duration_s":0.002108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 148.581475] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.806Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"10151a0a1aec52acc03ced8a","created_at":"2026-09-14T09:45:15.143Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dda5bdccccd9dc58999caf716bc591bd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.154Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-10151a0a1aec52acc03ced8a: start","job_status":"start","queue_duration_s":1.652412,"scheduling_latency_s":1.652426}1348gitlab # [ 148.621594] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"10151a0a1aec52acc03ced8a","created_at":"2026-09-14T09:45:15.143Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dda5bdccccd9dc58999caf716bc591bd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.154Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-10151a0a1aec52acc03ced8a: done: 0.019139 sec","job_status":"done","queue_duration_s":1.652412,"scheduling_latency_s":1.652426,"redis_calls":10,"redis_duration_s":0.001469,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000217625,"duration_s":0.019139,"completed_at":"2026-09-14T09:45:16.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 148.666712] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"e982b4f3827158c0bbaf3f4b","created_at":"2026-09-14T09:45:15.158Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f96e200e0279919d1c409a0215af2af2","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.168Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-e982b4f3827158c0bbaf3f4b: start","job_status":"start","queue_duration_s":1.658696,"scheduling_latency_s":1.658709}1350gitlab # [ 148.667598] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.847Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"e982b4f3827158c0bbaf3f4b","created_at":"2026-09-14T09:45:15.158Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f96e200e0279919d1c409a0215af2af2","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.168Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-e982b4f3827158c0bbaf3f4b: done: 0.020403 sec","job_status":"done","queue_duration_s":1.658696,"scheduling_latency_s":1.658709,"redis_calls":10,"redis_duration_s":0.0013700000000000001,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000247238,"duration_s":0.020403,"completed_at":"2026-09-14T09:45:16.847Z","load_balancing_strategy":"primary","db_duration_s":0.004668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 148.677594] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"86c1dbc2d72cff1fe7251725","created_at":"2026-09-14T09:45:15.173Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"284b093cf7409e7178beef386f64daab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.191Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-86c1dbc2d72cff1fe7251725: start","job_status":"start","queue_duration_s":1.657113,"scheduling_latency_s":1.657127}1352gitlab # [ 148.690737] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.878Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"86c1dbc2d72cff1fe7251725","created_at":"2026-09-14T09:45:15.173Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-1d4f851a5ba740b4","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"284b093cf7409e7178beef386f64daab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.191Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-86c1dbc2d72cff1fe7251725: done: 0.030413 sec","job_status":"done","queue_duration_s":1.657113,"scheduling_latency_s":1.657127,"redis_calls":12,"redis_duration_s":0.001684,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000655,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00033468,"exclusive_lock_hold_duration_s":0.016288382999999997,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.030413,"completed_at":"2026-09-14T09:45:16.878Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 148.746066] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.879Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3738f01b5690b2d36c5cee52","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3738f01b5690b2d36c5cee52: start","job_status":"start","queue_duration_s":1.172248,"scheduling_latency_s":1.172261}1354gitlab # [ 148.746719] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.891Z","message":"No existing merge request to be cleaned up."}1355gitlab # [ 148.747468] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.916Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3738f01b5690b2d36c5cee52","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3738f01b5690b2d36c5cee52: done: 0.036449 sec","job_status":"done","queue_duration_s":1.172248,"scheduling_latency_s":1.172261,"redis_calls":13,"redis_duration_s":0.005032,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000258,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002865,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000923023,"duration_s":0.036449,"completed_at":"2026-09-14T09:45:16.916Z","load_balancing_strategy":"primary","db_duration_s":0.006794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 148.814762] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.919Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9faef32928591f44ce8f98ae","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9faef32928591f44ce8f98ae: start","job_status":"start","queue_duration_s":1.211508,"scheduling_latency_s":1.211539}1357gitlab # [ 148.815620] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.938Z","message":"No existing merge request to be cleaned up."}1358gitlab # [ 148.816087] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.949Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9faef32928591f44ce8f98ae","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9faef32928591f44ce8f98ae: done: 0.03009 sec","job_status":"done","queue_duration_s":1.211508,"scheduling_latency_s":1.211539,"redis_calls":10,"redis_duration_s":0.004967,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001738,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003229,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03009,"completed_at":"2026-09-14T09:45:16.948Z","load_balancing_strategy":"primary","db_duration_s":0.002336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 148.863957] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.950Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"49ca0c586a2cc3206c4320ad","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-49ca0c586a2cc3206c4320ad: start","job_status":"start","queue_duration_s":1.24306,"scheduling_latency_s":1.243087}1360gitlab # [ 148.864704] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.959Z","message":"No existing merge request to be cleaned up."}1361gitlab # [ 148.865533] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.963Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"49ca0c586a2cc3206c4320ad","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-49ca0c586a2cc3206c4320ad: done: 0.013196 sec","job_status":"done","queue_duration_s":1.24306,"scheduling_latency_s":1.243087,"redis_calls":10,"redis_duration_s":0.001367,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013196,"completed_at":"2026-09-14T09:45:16.963Z","load_balancing_strategy":"primary","db_duration_s":0.001096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 148.873852] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.964Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a676ce47c71d21870e23e77","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a676ce47c71d21870e23e77: start","job_status":"start","queue_duration_s":1.257053,"scheduling_latency_s":1.257066}1363gitlab # [ 148.885120] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.970Z","message":"No existing merge request to be cleaned up."}1364gitlab # [ 148.886805] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.981Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a676ce47c71d21870e23e77","created_at":"2026-09-14T09:45:15.688Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-2a9238cd749f4acb","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"4868298b328eeedee6d39d022ca6d760","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:15.707Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a676ce47c71d21870e23e77: done: 0.01692 sec","job_status":"done","queue_duration_s":1.257053,"scheduling_latency_s":1.257066,"redis_calls":10,"redis_duration_s":0.004879,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003576,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01692,"completed_at":"2026-09-14T09:45:16.981Z","load_balancing_strategy":"primary","db_duration_s":0.002895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 148.946818] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:16.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"196678e3df1bdd73edfa977e","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-196678e3df1bdd73edfa977e: start","job_status":"start","queue_duration_s":0.185092,"scheduling_latency_s":0.185107}1366gitlab # [ 148.947680] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"196678e3df1bdd73edfa977e","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-196678e3df1bdd73edfa977e: done: 0.022432 sec","job_status":"done","queue_duration_s":0.185092,"scheduling_latency_s":0.185107,"redis_calls":16,"redis_duration_s":0.008619,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005764,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000231315,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022432,"completed_at":"2026-09-14T09:45:17.007Z","load_balancing_strategy":"primary","db_duration_s":0.000541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 149.000840] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d50289de5509dccff6b231eb","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d50289de5509dccff6b231eb: start","job_status":"start","queue_duration_s":0.208467,"scheduling_latency_s":0.208481}1368gitlab # [ 149.001718] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d50289de5509dccff6b231eb","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d50289de5509dccff6b231eb: done: 0.009834 sec","job_status":"done","queue_duration_s":0.208467,"scheduling_latency_s":0.208481,"redis_calls":13,"redis_duration_s":0.0015710000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009834,"completed_at":"2026-09-14T09:45:17.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 149.040861] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f78f8d26540aff88102711f","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f78f8d26540aff88102711f: start","job_status":"start","queue_duration_s":0.219229,"scheduling_latency_s":0.219243}1370gitlab # [ 149.041598] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f78f8d26540aff88102711f","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f78f8d26540aff88102711f: done: 0.009473 sec","job_status":"done","queue_duration_s":0.219229,"scheduling_latency_s":0.219243,"redis_calls":13,"redis_duration_s":0.001555,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009473,"completed_at":"2026-09-14T09:45:17.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 149.100254] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ffabc1d9a6b7e88f96a320","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ffabc1d9a6b7e88f96a320: start","job_status":"start","queue_duration_s":0.229559,"scheduling_latency_s":0.229572}1372gitlab # [ 149.100936] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21ffabc1d9a6b7e88f96a320","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21ffabc1d9a6b7e88f96a320: done: 0.009688 sec","job_status":"done","queue_duration_s":0.229559,"scheduling_latency_s":0.229572,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009688,"completed_at":"2026-09-14T09:45:17.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 149.144225] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37823630aaf54ce8c4e32458","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37823630aaf54ce8c4e32458: start","job_status":"start","queue_duration_s":0.240117,"scheduling_latency_s":0.24013}1374gitlab # [ 149.144974] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37823630aaf54ce8c4e32458","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37823630aaf54ce8c4e32458: done: 0.015984 sec","job_status":"done","queue_duration_s":0.240117,"scheduling_latency_s":0.24013,"redis_calls":13,"redis_duration_s":0.004115000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002497,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015984,"completed_at":"2026-09-14T09:45:17.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 149.191680] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fa762b92182a0cd22e44cfc","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fa762b92182a0cd22e44cfc: start","job_status":"start","queue_duration_s":0.256986,"scheduling_latency_s":0.256998}1376gitlab # [ 149.192606] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fa762b92182a0cd22e44cfc","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fa762b92182a0cd22e44cfc: done: 0.009662 sec","job_status":"done","queue_duration_s":0.256986,"scheduling_latency_s":0.256998,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001132,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009662,"completed_at":"2026-09-14T09:45:17.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 149.235142] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b85606fa457824d00bde371d","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b85606fa457824d00bde371d: start","job_status":"start","queue_duration_s":0.267495,"scheduling_latency_s":0.267509}1378gitlab # [ 149.235825] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b85606fa457824d00bde371d","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b85606fa457824d00bde371d: done: 0.009389 sec","job_status":"done","queue_duration_s":0.267495,"scheduling_latency_s":0.267509,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009389,"completed_at":"2026-09-14T09:45:17.076Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 149.247682] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"487fd397a3dea34b15722e1b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-487fd397a3dea34b15722e1b: start","job_status":"start","queue_duration_s":0.27804,"scheduling_latency_s":0.278054}1380gitlab # [ 149.258791] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"487fd397a3dea34b15722e1b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-487fd397a3dea34b15722e1b: done: 0.009351 sec","job_status":"done","queue_duration_s":0.27804,"scheduling_latency_s":0.278054,"redis_calls":13,"redis_duration_s":0.001569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009351,"completed_at":"2026-09-14T09:45:17.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 149.328661] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e11449f341f8ca9d04657beb","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e11449f341f8ca9d04657beb: start","job_status":"start","queue_duration_s":0.288254,"scheduling_latency_s":0.288267}1382gitlab # [ 149.329660] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e11449f341f8ca9d04657beb","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e11449f341f8ca9d04657beb: done: 0.018126 sec","job_status":"done","queue_duration_s":0.288254,"scheduling_latency_s":0.288267,"redis_calls":13,"redis_duration_s":0.009665,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002388,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007277,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018126,"completed_at":"2026-09-14T09:45:17.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 149.341720] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.108Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1003655df21d4da255e63cf7","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1003655df21d4da255e63cf7: start","job_status":"start","queue_duration_s":0.309038,"scheduling_latency_s":0.309054}1384gitlab # [ 149.388887] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1003655df21d4da255e63cf7","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1003655df21d4da255e63cf7: done: 0.019428 sec","job_status":"done","queue_duration_s":0.309038,"scheduling_latency_s":0.309054,"redis_calls":13,"redis_duration_s":0.008858,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019428,"completed_at":"2026-09-14T09:45:17.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 149.389447] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96ffcbb78242a595bc587bdd","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96ffcbb78242a595bc587bdd: start","job_status":"start","queue_duration_s":0.331068,"scheduling_latency_s":0.331082}1386gitlab # [ 149.429247] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"96ffcbb78242a595bc587bdd","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-96ffcbb78242a595bc587bdd: done: 0.010918 sec","job_status":"done","queue_duration_s":0.331068,"scheduling_latency_s":0.331082,"redis_calls":13,"redis_duration_s":0.0016380000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010918,"completed_at":"2026-09-14T09:45:17.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 149.433260] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578cf7683afa95be9ed40d09","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578cf7683afa95be9ed40d09: start","job_status":"start","queue_duration_s":0.342918,"scheduling_latency_s":0.342932}1388gitlab # [ 149.444654] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578cf7683afa95be9ed40d09","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578cf7683afa95be9ed40d09: done: 0.009739 sec","job_status":"done","queue_duration_s":0.342918,"scheduling_latency_s":0.342932,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009739,"completed_at":"2026-09-14T09:45:17.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 149.499679] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68465e3d5581024c4788efa0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68465e3d5581024c4788efa0: start","job_status":"start","queue_duration_s":0.353501,"scheduling_latency_s":0.353515}1390gitlab # [ 149.500633] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68465e3d5581024c4788efa0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68465e3d5581024c4788efa0: done: 0.009791 sec","job_status":"done","queue_duration_s":0.353501,"scheduling_latency_s":0.353515,"redis_calls":13,"redis_duration_s":0.0019459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009791,"completed_at":"2026-09-14T09:45:17.163Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 149.546264] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06b3bd5b49765d8b2f84ac4e","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06b3bd5b49765d8b2f84ac4e: start","job_status":"start","queue_duration_s":0.364137,"scheduling_latency_s":0.364151}1392gitlab # [ 149.546889] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.173Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06b3bd5b49765d8b2f84ac4e","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06b3bd5b49765d8b2f84ac4e: done: 0.009396 sec","job_status":"done","queue_duration_s":0.364137,"scheduling_latency_s":0.364151,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009396,"completed_at":"2026-09-14T09:45:17.173Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393gitlab # [ 149.599112] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9c7f35f5b9a92220ca22b0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9c7f35f5b9a92220ca22b0: start","job_status":"start","queue_duration_s":0.379044,"scheduling_latency_s":0.379061}1394gitlab # [ 149.599959] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb9c7f35f5b9a92220ca22b0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb9c7f35f5b9a92220ca22b0: done: 0.014109 sec","job_status":"done","queue_duration_s":0.379044,"scheduling_latency_s":0.379061,"redis_calls":13,"redis_duration_s":0.005253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003813,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006492,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014109,"completed_at":"2026-09-14T09:45:17.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 149.617081] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18f760fbe38da766097180df","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18f760fbe38da766097180df: start","job_status":"start","queue_duration_s":0.394075,"scheduling_latency_s":0.394088}1396gitlab # [ 149.662658] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18f760fbe38da766097180df","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18f760fbe38da766097180df: done: 0.009335 sec","job_status":"done","queue_duration_s":0.394075,"scheduling_latency_s":0.394088,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006032,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009335,"completed_at":"2026-09-14T09:45:17.203Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 149.663641] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b120c9e6abc3d2a685f45f6b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b120c9e6abc3d2a685f45f6b: start","job_status":"start","queue_duration_s":0.404275,"scheduling_latency_s":0.404288}1398gitlab # [ 149.673979] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b120c9e6abc3d2a685f45f6b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b120c9e6abc3d2a685f45f6b: done: 0.009241 sec","job_status":"done","queue_duration_s":0.404275,"scheduling_latency_s":0.404288,"redis_calls":13,"redis_duration_s":0.0015570000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009241,"completed_at":"2026-09-14T09:45:17.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 149.709966] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b05b8508377f208bfb72bf0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b05b8508377f208bfb72bf0: start","job_status":"start","queue_duration_s":0.414511,"scheduling_latency_s":0.414523}1400gitlab # [ 149.751263] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b05b8508377f208bfb72bf0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b05b8508377f208bfb72bf0: done: 0.009193 sec","job_status":"done","queue_duration_s":0.414511,"scheduling_latency_s":0.414523,"redis_calls":13,"redis_duration_s":0.0016159999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006115,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009193,"completed_at":"2026-09-14T09:45:17.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 149.755454] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85904950e7d3f54709e9c2f4","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85904950e7d3f54709e9c2f4: start","job_status":"start","queue_duration_s":0.424633,"scheduling_latency_s":0.424645}1402gitlab # [ 149.766809] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85904950e7d3f54709e9c2f4","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85904950e7d3f54709e9c2f4: done: 0.011455 sec","job_status":"done","queue_duration_s":0.424633,"scheduling_latency_s":0.424645,"redis_calls":13,"redis_duration_s":0.003563,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.011455,"completed_at":"2026-09-14T09:45:17.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 149.838682] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5cccf530d0cd9b16ae7356f","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5cccf530d0cd9b16ae7356f: start","job_status":"start","queue_duration_s":0.43698,"scheduling_latency_s":0.436994}1404gitlab # [ 149.839619] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5cccf530d0cd9b16ae7356f","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5cccf530d0cd9b16ae7356f: done: 0.009351 sec","job_status":"done","queue_duration_s":0.43698,"scheduling_latency_s":0.436994,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009351,"completed_at":"2026-09-14T09:45:17.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 149.880044] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb17b467e63b416b9091688c","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb17b467e63b416b9091688c: start","job_status":"start","queue_duration_s":0.447204,"scheduling_latency_s":0.447218}1406gitlab # [ 149.880757] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb17b467e63b416b9091688c","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb17b467e63b416b9091688c: done: 0.009309 sec","job_status":"done","queue_duration_s":0.447204,"scheduling_latency_s":0.447218,"redis_calls":13,"redis_duration_s":0.001579,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009309,"completed_at":"2026-09-14T09:45:17.256Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 149.920069] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f9fa2991c24e479a924958","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f9fa2991c24e479a924958: start","job_status":"start","queue_duration_s":0.457448,"scheduling_latency_s":0.457461}1408gitlab # [ 149.920702] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94f9fa2991c24e479a924958","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94f9fa2991c24e479a924958: done: 0.009385 sec","job_status":"done","queue_duration_s":0.457448,"scheduling_latency_s":0.457461,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009385,"completed_at":"2026-09-14T09:45:17.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 149.969148] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95332913501fa4ddf37a66b9","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95332913501fa4ddf37a66b9: start","job_status":"start","queue_duration_s":0.473142,"scheduling_latency_s":0.473158}1410gitlab # [ 149.969861] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95332913501fa4ddf37a66b9","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95332913501fa4ddf37a66b9: done: 0.017157 sec","job_status":"done","queue_duration_s":0.473142,"scheduling_latency_s":0.473158,"redis_calls":13,"redis_duration_s":0.008199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001822,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006377,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017157,"completed_at":"2026-09-14T09:45:17.290Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 150.011100] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4cc9ead0f001779b21fe315","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4cc9ead0f001779b21fe315: start","job_status":"start","queue_duration_s":0.491234,"scheduling_latency_s":0.491247}1412gitlab # [ 150.011941] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4cc9ead0f001779b21fe315","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4cc9ead0f001779b21fe315: done: 0.009636 sec","job_status":"done","queue_duration_s":0.491234,"scheduling_latency_s":0.491247,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009636,"completed_at":"2026-09-14T09:45:17.300Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 150.029027] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01111415cd9cf47f76c90463","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01111415cd9cf47f76c90463: start","job_status":"start","queue_duration_s":0.501847,"scheduling_latency_s":0.501861}1414gitlab # [ 150.040602] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01111415cd9cf47f76c90463","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01111415cd9cf47f76c90463: done: 0.009275 sec","job_status":"done","queue_duration_s":0.501847,"scheduling_latency_s":0.501861,"redis_calls":13,"redis_duration_s":0.0016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009275,"completed_at":"2026-09-14T09:45:17.310Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 150.084808] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acaa3d49141ad0bbe05acd55","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acaa3d49141ad0bbe05acd55: start","job_status":"start","queue_duration_s":0.512154,"scheduling_latency_s":0.512167}1416gitlab # [ 150.086155] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"acaa3d49141ad0bbe05acd55","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-acaa3d49141ad0bbe05acd55: done: 0.009384 sec","job_status":"done","queue_duration_s":0.512154,"scheduling_latency_s":0.512167,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006252,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009384,"completed_at":"2026-09-14T09:45:17.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 150.128257] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"312cc9dc2cc453f494f142c7","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-312cc9dc2cc453f494f142c7: start","job_status":"start","queue_duration_s":0.522486,"scheduling_latency_s":0.522499}1418gitlab # [ 150.131283] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"312cc9dc2cc453f494f142c7","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-312cc9dc2cc453f494f142c7: done: 0.0136 sec","job_status":"done","queue_duration_s":0.522486,"scheduling_latency_s":0.522499,"redis_calls":13,"redis_duration_s":0.005567,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0136,"completed_at":"2026-09-14T09:45:17.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 150.176278] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee2d08cdb90e621aa3043cba","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee2d08cdb90e621aa3043cba: start","job_status":"start","queue_duration_s":0.537075,"scheduling_latency_s":0.537088}1420gitlab # [ 150.176978] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ee2d08cdb90e621aa3043cba","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ee2d08cdb90e621aa3043cba: done: 0.009458 sec","job_status":"done","queue_duration_s":0.537075,"scheduling_latency_s":0.537088,"redis_calls":13,"redis_duration_s":0.0016849999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009458,"completed_at":"2026-09-14T09:45:17.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 150.215141] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbe3ec24504f1f779acf8e45","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbe3ec24504f1f779acf8e45: start","job_status":"start","queue_duration_s":0.547455,"scheduling_latency_s":0.547471}1422gitlab # [ 150.252949] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbe3ec24504f1f779acf8e45","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbe3ec24504f1f779acf8e45: done: 0.009427 sec","job_status":"done","queue_duration_s":0.547455,"scheduling_latency_s":0.547471,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009427,"completed_at":"2026-09-14T09:45:17.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 150.255616] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da641b0d2bb9ee7ac862b48b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da641b0d2bb9ee7ac862b48b: start","job_status":"start","queue_duration_s":0.557873,"scheduling_latency_s":0.557886}1424gitlab # [ 150.267291] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da641b0d2bb9ee7ac862b48b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da641b0d2bb9ee7ac862b48b: done: 0.00941 sec","job_status":"done","queue_duration_s":0.557873,"scheduling_latency_s":0.557886,"redis_calls":13,"redis_duration_s":0.001588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.00941,"completed_at":"2026-09-14T09:45:17.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 150.308314] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9670816ecc7d47f210fb7125","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9670816ecc7d47f210fb7125: start","job_status":"start","queue_duration_s":0.568417,"scheduling_latency_s":0.56843}1426gitlab # [ 150.349491] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9670816ecc7d47f210fb7125","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9670816ecc7d47f210fb7125: done: 0.015707 sec","job_status":"done","queue_duration_s":0.568417,"scheduling_latency_s":0.56843,"redis_calls":13,"redis_duration_s":0.007584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015707,"completed_at":"2026-09-14T09:45:17.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 150.350565] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2799e99db56c39329e933eb0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2799e99db56c39329e933eb0: start","job_status":"start","queue_duration_s":0.585068,"scheduling_latency_s":0.585082}1428gitlab # [ 150.357718] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2799e99db56c39329e933eb0","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2799e99db56c39329e933eb0: done: 0.009492 sec","job_status":"done","queue_duration_s":0.585068,"scheduling_latency_s":0.585082,"redis_calls":13,"redis_duration_s":0.0015670000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009492,"completed_at":"2026-09-14T09:45:17.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 150.398972] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1014faf96349ec4662d3ca27","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1014faf96349ec4662d3ca27: start","job_status":"start","queue_duration_s":0.595466,"scheduling_latency_s":0.59548}1430gitlab # [ 150.436994] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1014faf96349ec4662d3ca27","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1014faf96349ec4662d3ca27: done: 0.009742 sec","job_status":"done","queue_duration_s":0.595466,"scheduling_latency_s":0.59548,"redis_calls":13,"redis_duration_s":0.001602,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009742,"completed_at":"2026-09-14T09:45:17.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 150.438196] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"387de976ec61e2446063509d","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-387de976ec61e2446063509d: start","job_status":"start","queue_duration_s":0.606139,"scheduling_latency_s":0.606152}1432gitlab # [ 150.475865] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"387de976ec61e2446063509d","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-387de976ec61e2446063509d: done: 0.009643 sec","job_status":"done","queue_duration_s":0.606139,"scheduling_latency_s":0.606152,"redis_calls":13,"redis_duration_s":0.001593,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009643,"completed_at":"2026-09-14T09:45:17.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 150.481841] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08e03c87a02dfa36d668d109","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08e03c87a02dfa36d668d109: start","job_status":"start","queue_duration_s":0.616704,"scheduling_latency_s":0.616718}1434gitlab # [ 150.524101] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08e03c87a02dfa36d668d109","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08e03c87a02dfa36d668d109: done: 0.013043 sec","job_status":"done","queue_duration_s":0.616704,"scheduling_latency_s":0.616718,"redis_calls":13,"redis_duration_s":0.004958000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013043,"completed_at":"2026-09-14T09:45:17.429Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 150.562721] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13f24913e99851f8808afd2a","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13f24913e99851f8808afd2a: start","job_status":"start","queue_duration_s":0.630768,"scheduling_latency_s":0.630782}1436gitlab # [ 150.563459] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13f24913e99851f8808afd2a","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13f24913e99851f8808afd2a: done: 0.009573 sec","job_status":"done","queue_duration_s":0.630768,"scheduling_latency_s":0.630782,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009573,"completed_at":"2026-09-14T09:45:17.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 150.572629] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04fe0fbf52316de4ca5ea404","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04fe0fbf52316de4ca5ea404: start","job_status":"start","queue_duration_s":0.641232,"scheduling_latency_s":0.641244}1438gitlab # [ 150.613185] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04fe0fbf52316de4ca5ea404","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04fe0fbf52316de4ca5ea404: done: 0.009434 sec","job_status":"done","queue_duration_s":0.641232,"scheduling_latency_s":0.641244,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009434,"completed_at":"2026-09-14T09:45:17.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 150.617919] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51f06fa97a7d384f43054b55","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51f06fa97a7d384f43054b55: start","job_status":"start","queue_duration_s":0.651574,"scheduling_latency_s":0.651587}1440gitlab # [ 150.629150] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51f06fa97a7d384f43054b55","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51f06fa97a7d384f43054b55: done: 0.015898 sec","job_status":"done","queue_duration_s":0.651574,"scheduling_latency_s":0.651587,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006164,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015898,"completed_at":"2026-09-14T09:45:17.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 150.670637] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2928ed13d8dddcb4d46a73e","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2928ed13d8dddcb4d46a73e: start","job_status":"start","queue_duration_s":0.670077,"scheduling_latency_s":0.670111}1442gitlab # [ 150.711119] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2928ed13d8dddcb4d46a73e","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2928ed13d8dddcb4d46a73e: done: 0.013088 sec","job_status":"done","queue_duration_s":0.670077,"scheduling_latency_s":0.670111,"redis_calls":13,"redis_duration_s":0.0017209999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000587,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013088,"completed_at":"2026-09-14T09:45:17.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 150.712177] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8397bef45f689858a75da757","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8397bef45f689858a75da757: start","job_status":"start","queue_duration_s":0.684092,"scheduling_latency_s":0.684106}1444gitlab # [ 150.753736] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8397bef45f689858a75da757","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8397bef45f689858a75da757: done: 0.009554 sec","job_status":"done","queue_duration_s":0.684092,"scheduling_latency_s":0.684106,"redis_calls":13,"redis_duration_s":0.001649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.009554,"completed_at":"2026-09-14T09:45:17.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 150.754733] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00928cab1373363116f4c6c8","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00928cab1373363116f4c6c8: start","job_status":"start","queue_duration_s":0.694594,"scheduling_latency_s":0.694607}1446gitlab # [ 150.765451] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00928cab1373363116f4c6c8","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00928cab1373363116f4c6c8: done: 0.010031 sec","job_status":"done","queue_duration_s":0.694594,"scheduling_latency_s":0.694607,"redis_calls":13,"redis_duration_s":0.0018310000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001294,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010031,"completed_at":"2026-09-14T09:45:17.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 150.805081] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d07b68392a15edf67fc303b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d07b68392a15edf67fc303b: start","job_status":"start","queue_duration_s":0.705503,"scheduling_latency_s":0.705516}1448gitlab # [ 150.810840] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d07b68392a15edf67fc303b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d07b68392a15edf67fc303b: done: 0.010434 sec","job_status":"done","queue_duration_s":0.705503,"scheduling_latency_s":0.705516,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010434,"completed_at":"2026-09-14T09:45:17.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 150.846718] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecfc3e9b9a826746368fd06d","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecfc3e9b9a826746368fd06d: start","job_status":"start","queue_duration_s":0.716799,"scheduling_latency_s":0.71684}1450gitlab # [ 150.857810] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ecfc3e9b9a826746368fd06d","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ecfc3e9b9a826746368fd06d: done: 0.01029 sec","job_status":"done","queue_duration_s":0.716799,"scheduling_latency_s":0.71684,"redis_calls":13,"redis_duration_s":0.001984,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01029,"completed_at":"2026-09-14T09:45:17.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 150.903644] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bb4a509330dc4a9441f4154","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bb4a509330dc4a9441f4154: start","job_status":"start","queue_duration_s":0.728237,"scheduling_latency_s":0.72825}1452gitlab # [ 150.904569] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bb4a509330dc4a9441f4154","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bb4a509330dc4a9441f4154: done: 0.010164 sec","job_status":"done","queue_duration_s":0.728237,"scheduling_latency_s":0.72825,"redis_calls":13,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010164,"completed_at":"2026-09-14T09:45:17.538Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 150.947547] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86bbe943be65b8e21984c240","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86bbe943be65b8e21984c240: start","job_status":"start","queue_duration_s":0.73959,"scheduling_latency_s":0.739603}1454gitlab # [ 150.949594] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86bbe943be65b8e21984c240","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86bbe943be65b8e21984c240: done: 0.01014 sec","job_status":"done","queue_duration_s":0.73959,"scheduling_latency_s":0.739603,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01014,"completed_at":"2026-09-14T09:45:17.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 150.998313] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8759e6234376ce4add578cac","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8759e6234376ce4add578cac: start","job_status":"start","queue_duration_s":0.750881,"scheduling_latency_s":0.750894}1456gitlab # [ 150.998931] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8759e6234376ce4add578cac","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8759e6234376ce4add578cac: done: 0.010267 sec","job_status":"done","queue_duration_s":0.750881,"scheduling_latency_s":0.750894,"redis_calls":13,"redis_duration_s":0.001659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010267,"completed_at":"2026-09-14T09:45:17.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 151.047529] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7705fd70f6d5b0b9b5e71b64","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7705fd70f6d5b0b9b5e71b64: start","job_status":"start","queue_duration_s":0.762294,"scheduling_latency_s":0.762308}1458gitlab # [ 151.048166] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7705fd70f6d5b0b9b5e71b64","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7705fd70f6d5b0b9b5e71b64: done: 0.01036 sec","job_status":"done","queue_duration_s":0.762294,"scheduling_latency_s":0.762308,"redis_calls":13,"redis_duration_s":0.0017000000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01036,"completed_at":"2026-09-14T09:45:17.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 151.089532] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13e613eb639894ee15d7b521","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13e613eb639894ee15d7b521: start","job_status":"start","queue_duration_s":0.773835,"scheduling_latency_s":0.773848}1460gitlab # [ 151.090400] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13e613eb639894ee15d7b521","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13e613eb639894ee15d7b521: done: 0.010474 sec","job_status":"done","queue_duration_s":0.773835,"scheduling_latency_s":0.773848,"redis_calls":13,"redis_duration_s":0.0016939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010474,"completed_at":"2026-09-14T09:45:17.584Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 151.135821] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c74c0f00923d07ef2bb2d26b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c74c0f00923d07ef2bb2d26b: start","job_status":"start","queue_duration_s":0.785231,"scheduling_latency_s":0.785245}1462gitlab # [ 151.136770] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c74c0f00923d07ef2bb2d26b","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c74c0f00923d07ef2bb2d26b: done: 0.010555 sec","job_status":"done","queue_duration_s":0.785231,"scheduling_latency_s":0.785245,"redis_calls":13,"redis_duration_s":0.001944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001377,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.010555,"completed_at":"2026-09-14T09:45:17.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 151.200171] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22d892090b7c291b441264db","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22d892090b7c291b441264db: start","job_status":"start","queue_duration_s":0.796701,"scheduling_latency_s":0.796716}1464gitlab # [ 151.200869] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:17.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22d892090b7c291b441264db","created_at":"2026-09-14T09:45:16.700Z","trace_propagation_headers":{"sentry-trace":"ede64bf17fd340d2a53d929b4360e0af-6ad1885c917e415f","baggage":"sentry-trace_id=ede64bf17fd340d2a53d929b4360e0af,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"40d71c52a709b9f783f2bbbd30f0b378","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:45:16.799Z","job_size_bytes":2,"pid":1633,"sidekiq_tid":"maet","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22d892090b7c291b441264db: done: 0.01074 sec","job_status":"done","queue_duration_s":0.796701,"scheduling_latency_s":0.796716,"redis_calls":13,"redis_duration_s":0.001663,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01074,"completed_at":"2026-09-14T09:45:17.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 151.395684] clocksource: Long readout interval, skipping watchdog check: cs_nsec: 2991326925 wd_nsec: 29913271131466gitlab # [ 161.892245] setup-gitlab-start[2220]: W, [2026-09-14T09:45:30.117810 #2220] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1467gitlab # [ 184.227246] postgres[2417]: [2417] ERROR: relation "table_without_models" does not exist1468gitlab # [ 184.230337] postgres[2417]: [2417] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1469gitlab # [ 187.201668] runuser[2219]: pam_unix(runuser:session): session closed for user gitlab1470gitlab # [ 187.202839] setup-gitlab-start[2194]: + systemctl restart gitlab-sidekiq.service1471gitlab # [ 187.234589] systemd[1]: Stopping gitlab-sidekiq.service...1472gitlab # [ 187.235873] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:55.460Z","message":"Shutting down"}1473gitlab # [ 187.237332] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:55.461Z","message":"Scheduler exiting..."}1474gitlab # [ 187.238798] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:55.461Z","message":"Terminating quiet threads for default capsule"}1475gitlab # [ 187.240577] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:55.462Z","message":"Scheduler exiting..."}1476gitlab # [ 187.737732] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:55.963Z","message":"Pausing to allow jobs to finish..."}1477gitlab # [ 189.741557] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:57.966Z","message":"Bye!"}1478gitlab # [ 189.767412] sidekiq-cluster[1633]: {"severity":"INFO","time":"2026-09-14T09:45:57.993Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1633,"worker_id":"sidekiq_0","memwd_rss_bytes":923205632,"retry":0}1479gitlab # [ 190.048921] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1480gitlab # [ 190.049787] systemd[1]: Stopped gitlab-sidekiq.service.1481gitlab # [ 190.050722] systemd[1]: gitlab-sidekiq.service: Consumed 56.801s CPU time over 1min 55.198s wall clock time, 952.4M memory peak, 4.4M read from disk.1482gitlab # [ 190.054847] systemd[1]: Started gitlab-sidekiq.service.1483gitlab # [ 190.059824] setup-gitlab-start[2194]: + mkdir -p /var/lib/secrets1484gitlab # [ 190.061381] setup-gitlab-start[2194]: + echo nixbot-test-token-of-20-chars1485gitlab # [ 190.062422] setup-gitlab-start[2194]: + chmod 644 /var/lib/secrets/gitlab-token1486gitlab # [ 190.063564] setup-gitlab-start[2194]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1487gitlab # [ 190.253442] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:45:58 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 1691488gitlab # [ 190.704672] gitaly[914]: time="2026-09-14T09:45:58.930Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:08.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:58.930" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1489gitlab # [ 190.705257] gitaly[914]: time="2026-09-14T09:45:58.930Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:08.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:58.930" grpc.time_ms=0.271 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1490gitlab # [ 190.795366] gitaly[914]: time="2026-09-14T09:45:59.021Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.020" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1491gitlab # [ 190.796301] gitaly[914]: time="2026-09-14T09:45:59.022Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.020" grpc.time_ms=0.988 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1492gitlab # [ 190.891673] gitaly[914]: time="2026-09-14T09:45:59.118Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A diskcache=dfdaf29b-a4a3-471f-8eea-1a567318e896 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:46:09.054" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.065" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1493gitlab # [ 190.892681] gitaly[914]: time="2026-09-14T09:45:59.118Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1578 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:46:09.054" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.065" grpc.time_ms=52.904 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1494gitlab # [ 190.936526] gitaly[914]: time="2026-09-14T09:45:59.162Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.162" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1495gitlab # [ 190.937330] gitaly[914]: time="2026-09-14T09:45:59.163Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.162" grpc.time_ms=0.554 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1496gitlab # [ 190.968256] gitaly[914]: time="2026-09-14T09:45:59.194Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:46:09.172" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.183" grpc.time_ms=11.168 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1497gitlab # [ 191.034157] gitaly[914]: time="2026-09-14T09:45:59.260Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.249" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.260" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1498gitlab # [ 191.055595] gitaly[914]: time="2026-09-14T09:45:59.260Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.249" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.260" grpc.time_ms=0.267 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1499gitlab # [ 191.078588] gitaly[914]: time="2026-09-14T09:45:59.304Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A diskcache=df4fc10b-8930-4cc8-bb80-c2c6b72bc1e9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:46:09.252" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.263" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1500gitlab # [ 191.079456] gitaly[914]: time="2026-09-14T09:45:59.305Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1586 command.oublock=32 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:46:09.252" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.263" grpc.time_ms=41.675 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1501gitlab # [ 191.108121] gitaly[914]: time="2026-09-14T09:45:59.334Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.333" pid=914 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1502gitlab # [ 191.109841] gitaly[914]: time="2026-09-14T09:45:59.335Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.333" grpc.time_ms=1.964 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1503gitlab # [ 191.121414] gitaly[914]: time="2026-09-14T09:45:59.347Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:46:09.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.340" grpc.time_ms=7.353 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1504gitlab # [ 191.145389] gitaly[914]: time="2026-09-14T09:45:59.371Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:46:09.040" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.371" grpc.time_ms=0.197 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1505gitlab # [ 191.156155] gitaly[914]: time="2026-09-14T09:45:59.382Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T09:46:09.051" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.382" grpc.time_ms=0.304 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1506gitlab # [ 191.608139] gitaly[914]: time="2026-09-14T09:45:59.834Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMY8F50VNPFBX9NNEZWX4A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:46:09.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:45:59.822" grpc.time_ms=11.377 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1507gitlab # [ 191.864353] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:00 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 15881508gitlab # [ 191.869291] setup-gitlab-start[2469]: {"id":1,"message":null,"error":null}1509gitlab # [ 193.164721] sidekiq-cluster[2456]: {"severity":"INFO","time":"2026-09-14T09:46:01.373Z","message":"Starting cluster with 1 processes"}1510gitlab # [ 197.637546] gitaly[914]: time="2026-09-14T09:46:05.863Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYEY50EK0TV2DBA8VBBQ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:46:15.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:05.852" grpc.time_ms=8.918 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1511gitlab # [ 198.114069] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:06 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 12141512gitlab # [ 198.122344] setup-gitlab-start[2194]: + mkdir -p /tmp/test-flake1513gitlab # [ 198.124351] setup-gitlab-start[2194]: + cd /tmp/test-flake1514gitlab # [ 198.125335] setup-gitlab-start[2194]: + git init -b master1515gitlab # [ 198.154957] setup-gitlab-start[2555]: Initialized empty Git repository in /tmp/test-flake/.git/1516gitlab # [ 198.157791] setup-gitlab-start[2194]: + git config user.name test1517gitlab # [ 198.164241] setup-gitlab-start[2194]: + git config user.email test@example.com1518gitlab # [ 198.171232] setup-gitlab-start[2194]: + cat1519gitlab # [ 198.177056] setup-gitlab-start[2194]: + git add flake.nix1520gitlab # [ 198.184622] setup-gitlab-start[2194]: + git commit -m 'initial commit'1521gitlab # [ 198.213337] setup-gitlab-start[2560]: [master (root-commit) 660fc87] initial commit1522gitlab # [ 198.214092] setup-gitlab-start[2560]: 1 file changed, 10 insertions(+)1523gitlab # [ 198.214781] setup-gitlab-start[2560]: create mode 100644 flake.nix1524gitlab # [ 198.219716] setup-gitlab-start[2194]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1525gitlab # [ 198.231084] setup-gitlab-start[2194]: + git push -u origin master1526gitlab # [ 198.302081] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:06 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 351527gitlab # [ 198.438961] gitaly[914]: time="2026-09-14T09:46:06.665Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGA54NXTQNW7APAKTYBC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:06.653" grpc.time_ms=11.574 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1528gitlab # [ 198.468357] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:06 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 1601529gitlab # [ 198.724326] gitaly[914]: time="2026-09-14T09:46:06.949Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:46:16.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:06.936" grpc.time_ms=13.359 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1530gitlab # [ 198.783648] gitaly[914]: time="2026-09-14T09:46:07.009Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=331 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-14T09:46:37.001" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-14T09:46:07.001" grpc.time_ms=7.788 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1531gitlab # [ 198.831105] gitaly[914]: time="2026-09-14T09:46:07.057Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 duration_ms=186ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1532gitlab # [ 198.856774] gitaly[914]: time="2026-09-14T09:46:07.083Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 duration_ms=24ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1533gitlab # [ 198.857419] gitaly[914]: time="2026-09-14T09:46:07.083Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:06.870" grpc.time_ms=213.426 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1534gitlab # [ 198.906051] gitaly[914]: time="2026-09-14T09:46:07.132Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:07.129" grpc.time_ms=3.116 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1535gitlab # [ 198.955520] gitaly[914]: time="2026-09-14T09:46:07.181Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:07.181" grpc.time_ms=0.517 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1536gitlab # [ 198.986730] gitaly[914]: time="2026-09-14T09:46:07.213Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:07.212" grpc.time_ms=0.355 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1537gitlab # [ 199.058894] gitaly[914]: time="2026-09-14T09:46:07.285Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:46:17.265" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:07.276" grpc.time_ms=8.802 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1538gitlab # [ 199.091516] gitaly[914]: time="2026-09-14T09:46:07.317Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1564 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-14T09:46:17.293" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:07.303" grpc.time_ms=13.927 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1539gitlab # [ 199.114348] gitaly[914]: time="2026-09-14T09:46:07.340Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 duration_ms=98ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1540gitlab # [ 199.117576] gitaly[914]: time="2026-09-14T09:46:07.344Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:07.241" grpc.time_ms=102.367 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1541gitlab # [ 199.136451] gitaly[914]: time="2026-09-14T09:46:07.362Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 diskcache=99eb8963-3c79-41d8-ac10-8b3d13a4ae86 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:06.785" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1542gitlab # [ 199.136840] gitaly[914]: time="2026-09-14T09:46:07.363Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=207 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=892928 command.minflt=13940 command.oublock=32 command.real_time_ms=566 command.spawn_token_fork_ms=0 command.system_time_ms=133 command.user_time_ms=74 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:06.785" grpc.time_ms=577.104 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1543gitlab # [ 199.137849] gitlab-workhorse[824]: time="2026-09-14T09:46:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521544gitlab # [ 199.138405] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:07 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6541545gitlab # [ 199.161787] setup-gitlab-start[2564]: To http://gitlab/root/test-flake.git1546gitlab # [ 199.162141] setup-gitlab-start[2564]: * [new branch] master -> master1547gitlab # [ 199.166892] setup-gitlab-start[2564]: branch 'master' set up to track 'origin/master'.1548gitlab # [ 199.170446] systemd[1]: Finished setup-gitlab.service.1549gitlab # [ 199.173217] systemd[1]: Starting nixbot CI service...1550gitlab: (finished: waiting for unit setup-gitlab.service, in 200.40 seconds)1551gitlab: waiting for unit nixbot.service1552gitlab # [ 200.441160] nixbot[2641]: {"ts": "2026-09-14T09:46:08.666Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1553gitlab # [ 200.476277] nixbot[2641]: {"ts": "2026-09-14T09:46:08.702Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1554gitlab # [ 200.504634] nixbot[2641]: {"ts": "2026-09-14T09:46:08.730Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1555gitlab # [ 200.510981] nixbot[2641]: {"ts": "2026-09-14T09:46:08.737Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1556gitlab # [ 200.517229] nixbot[2641]: {"ts": "2026-09-14T09:46:08.743Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1557gitlab # [ 200.531647] nixbot[2641]: {"ts": "2026-09-14T09:46:08.757Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1558gitlab # [ 200.540335] nixbot[2641]: {"ts": "2026-09-14T09:46:08.766Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1559gitlab # [ 200.547265] nixbot[2641]: {"ts": "2026-09-14T09:46:08.773Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1560gitlab # [ 200.556095] nixbot[2641]: {"ts": "2026-09-14T09:46:08.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1561gitlab # [ 200.563449] nixbot[2641]: {"ts": "2026-09-14T09:46:08.789Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1562gitlab # [ 200.570988] nixbot[2641]: {"ts": "2026-09-14T09:46:08.797Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1563gitlab # [ 200.580076] nixbot[2641]: {"ts": "2026-09-14T09:46:08.806Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1564gitlab # [ 200.584838] nixbot[2641]: {"ts": "2026-09-14T09:46:08.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1565gitlab # [ 200.591764] nixbot[2641]: {"ts": "2026-09-14T09:46:08.818Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1566gitlab # [ 200.598154] nixbot[2641]: {"ts": "2026-09-14T09:46:08.824Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1567gitlab # [ 200.605517] nixbot[2641]: {"ts": "2026-09-14T09:46:08.831Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1568gitlab # [ 200.609106] nixbot[2641]: {"ts": "2026-09-14T09:46:08.835Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1569gitlab # [ 200.616225] nixbot[2641]: {"ts": "2026-09-14T09:46:08.842Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1570gitlab # [ 200.625457] nixbot[2641]: {"ts": "2026-09-14T09:46:08.851Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1571gitlab # [ 200.629559] nixbot[2641]: {"ts": "2026-09-14T09:46:08.855Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1572gitlab # [ 200.633812] nixbot[2641]: {"ts": "2026-09-14T09:46:08.860Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1573gitlab # [ 200.639984] nixbot[2641]: {"ts": "2026-09-14T09:46:08.866Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1574gitlab # [ 200.644105] nixbot[2641]: {"ts": "2026-09-14T09:46:08.870Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1575gitlab # [ 200.648291] nixbot[2641]: {"ts": "2026-09-14T09:46:08.874Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1576gitlab # [ 200.652371] nixbot[2641]: {"ts": "2026-09-14T09:46:08.878Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1577gitlab # [ 200.656859] nixbot[2641]: {"ts": "2026-09-14T09:46:08.883Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1578gitlab # [ 200.661077] nixbot[2641]: {"ts": "2026-09-14T09:46:08.887Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1579gitlab # [ 200.665348] nixbot[2641]: {"ts": "2026-09-14T09:46:08.891Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1580gitlab # [ 200.669210] nixbot[2641]: {"ts": "2026-09-14T09:46:08.895Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1581gitlab # [ 200.686459] nixbot[2641]: {"ts": "2026-09-14T09:46:08.912Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1582gitlab # [ 200.695365] nixbot[2641]: {"ts": "2026-09-14T09:46:08.921Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1583gitlab # [ 200.698898] nixbot[2641]: {"ts": "2026-09-14T09:46:08.925Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1584gitlab # [ 200.703310] nixbot[2641]: {"ts": "2026-09-14T09:46:08.929Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1585gitlab # [ 200.709331] nixbot[2641]: {"ts": "2026-09-14T09:46:08.935Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1586gitlab # [ 200.713383] nixbot[2641]: {"ts": "2026-09-14T09:46:08.939Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1587gitlab # [ 200.723837] nixbot[2641]: {"ts": "2026-09-14T09:46:08.950Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1588gitlab # [ 200.729967] nixbot[2641]: {"ts": "2026-09-14T09:46:08.956Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1589gitlab # [ 201.075931] nixbot[2641]: INFO: Started server process [2641]1590gitlab # [ 201.076400] nixbot[2641]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1591gitlab # [ 201.093336] nixbot[2641]: INFO: ::ffff:127.0.0.1:33432 - "GET /health HTTP/1.1" 200 OK1592gitlab # [ 201.103172] systemd[1]: Started nixbot CI service.1593gitlab # [ 201.105790] systemd[1]: Reached target Multi-User System.1594gitlab # [ 201.107755] systemd[1]: Startup finished in 1.205s (kernel) + 3.601s (initrd) + 3min 16.298s (userspace) = 3min 21.104s.1595gitlab # [ 201.349159] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2521596gitlab # [ 201.354571] nixbot[2641]: {"ts": "2026-09-14T09:46:09.574Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1597gitlab # [ 201.387106] nixbot[2641]: {"ts": "2026-09-14T09:46:09.613Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1598gitlab # [ 201.460141] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 611599gitlab # [ 201.465771] nixbot[2641]: {"ts": "2026-09-14T09:46:09.687Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1600gitlab # [ 201.470980] nixbot[2641]: {"ts": "2026-09-14T09:46:09.688Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1601gitlab # [ 201.603318] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1381602gitlab # [ 201.608442] nixbot[2641]: {"ts": "2026-09-14T09:46:09.830Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1603gitlab # [ 201.801095] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1901604gitlab # [ 201.807701] nixbot[2641]: {"ts": "2026-09-14T09:46:10.033Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1605gitlab: (finished: waiting for unit nixbot.service, in 2.08 seconds)1606gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1607gitlab # [ 201.877146] nixbot[2641]: INFO: ::ffff:127.0.0.1:33440 - "GET /health HTTP/1.1" 200 OK1608gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.02 seconds)1609subtest: project discovered and webhook registered1610gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1611gitlab # [ 201.958671] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 491612gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.08 seconds)1613(finished: subtest: project discovered and webhook registered, in 0.08 seconds)1614subtest: push delivers the webhook1615gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'1616gitlab # [ 202.011219] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 1861617gitlab # [ 202.013421] nixbot[2641]: {"ts": "2026-09-14T09:46:10.238Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1618gitlab # [ 202.069347] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 541619gitlab # [ 202.071898] nixbot[2641]: {"ts": "2026-09-14T09:46:10.296Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1620gitlab # [ 202.127720] gitaly[914]: time="2026-09-14T09:46:10.353Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYKZW38KEB0V2W8AV75PJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-14T09:46:40.335" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:10.336" grpc.time_ms=16.852 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 202.168888] gitaly[914]: time="2026-09-14T09:46:10.395Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYKZW38KEB0V2W8AV75PJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:46:40.393" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:10.393" grpc.time_ms=0.918 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 202.197189] gitaly[914]: time="2026-09-14T09:46:10.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYKZW38KEB0V2W8AV75PJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-14T09:46:20.085" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:10.416" grpc.time_ms=7.259 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1623gitlab # [ 202.239351] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 1641624gitlab # [ 202.241908] nixbot[2641]: {"ts": "2026-09-14T09:46:10.466Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1625gitlab # [ 202.319234] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 741626gitlab # [ 202.320958] nixbot[2641]: {"ts": "2026-09-14T09:46:10.547Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1627gitlab # [ 202.326396] nixbot[2641]: {"ts": "2026-09-14T09:46:10.552Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1628gitlab # [ 202.414280] gitaly[914]: time="2026-09-14T09:46:10.640Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYM938TBR494J0NNJ15H1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.633" grpc.time_ms=6.982 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1629gitlab # [ 202.416900] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 461630gitlab # [ 202.516674] gitaly[914]: time="2026-09-14T09:46:10.742Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMAN5FQ836B3F0A18SXY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.728" pid=914 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1631gitlab # [ 202.516942] gitaly[914]: time="2026-09-14T09:46:10.743Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMAN5FQ836B3F0A18SXY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.728" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1632gitlab # [ 202.564310] gitaly[914]: time="2026-09-14T09:46:10.790Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=639 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMAN5FQ836B3F0A18SXY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.728" grpc.time_ms=61.352 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1633gitlab # [ 202.566614] gitlab-workhorse[824]: time="2026-09-14T09:46:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131634gitlab # [ 202.567954] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1461635gitlab # [ 202.642124] gitaly[914]: time="2026-09-14T09:46:10.868Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMFCD6DAVCZ3FX8M82K2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.845" pid=914 remote_ip="2001:db8:1::1" request_sha=773ee0fc69a47d907dc627bec89dd9122d5ced1f response_bytes=223 span.kind=server system=grpc1636gitlab # [ 202.642898] gitaly[914]: time="2026-09-14T09:46:10.868Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMFCD6DAVCZ3FX8M82K2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.845" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1637gitlab # [ 202.644316] gitaly[914]: time="2026-09-14T09:46:10.868Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1202 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMFCD6DAVCZ3FX8M82K2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.845" grpc.time_ms=23.247 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1638gitlab # [ 202.688723] gitlab-workhorse[824]: time="2026-09-14T09:46:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231639gitlab # [ 202.689584] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1181640gitlab # [ 202.772817] gitaly[914]: time="2026-09-14T09:46:10.999Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMMAN13F8696QQTK7PDM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:10.990" grpc.time_ms=8.04 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1641gitlab # [ 202.774218] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 451642gitlab # [ 202.818556] gitaly[914]: time="2026-09-14T09:46:11.044Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMNSDGACJSP709FY5VH1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.037" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1643gitlab # [ 202.820510] gitaly[914]: time="2026-09-14T09:46:11.044Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMNSDGACJSP709FY5VH1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.037" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1644gitlab # [ 202.822419] gitaly[914]: time="2026-09-14T09:46:11.045Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMNSDGACJSP709FY5VH1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.037" grpc.time_ms=7.536 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1645gitlab # [ 202.859351] gitlab-workhorse[824]: time="2026-09-14T09:46:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671646gitlab # [ 202.859770] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 841647gitlab # [ 202.940455] gitaly[914]: time="2026-09-14T09:46:11.166Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMSKBRKNFTQ8NRMYNQJ5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.158" grpc.time_ms=8.401 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1648gitlab # [ 202.943713] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 461649gitlab # [ 203.001077] gitaly[914]: time="2026-09-14T09:46:11.227Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMV5DMYWRT7NPY0A9T2K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.209" pid=914 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=214 span.kind=server system=grpc1650gitlab # [ 203.001516] gitaly[914]: time="2026-09-14T09:46:11.227Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMV5DMYWRT7NPY0A9T2K grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.209" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1651gitlab # [ 203.002646] gitaly[914]: time="2026-09-14T09:46:11.227Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1170 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMV5DMYWRT7NPY0A9T2K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:11.209" grpc.time_ms=18.577 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1652gitlab # [ 203.004366] gitlab-workhorse[824]: time="2026-09-14T09:46:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2141653gitlab # [ 203.005153] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.55.0" 551654gitlab # [ 203.116297] gitaly[914]: time="2026-09-14T09:46:11.342Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:46:41.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:11.341" grpc.time_ms=1.095 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 203.162122] gitaly[914]: time="2026-09-14T09:46:11.387Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-14T09:46:41.079" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:11.379" grpc.time_ms=7.789 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 203.200518] gitaly[914]: time="2026-09-14T09:46:11.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:46:21.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:11.418" grpc.time_ms=8.484 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 203.214931] gitaly[914]: time="2026-09-14T09:46:11.441Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=623 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:46:21.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:11.433" grpc.time_ms=7.897 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab # [ 203.279843] gitaly[914]: time="2026-09-14T09:46:11.506Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T09:46:21.094" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:11.505" grpc.time_ms=0.5 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1659gitlab # [ 203.315235] gitaly[914]: time="2026-09-14T09:46:11.541Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=617 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T09:46:21.120" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:11.531" grpc.time_ms=9.856 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1660gitlab # [ 203.383706] gitaly[914]: time="2026-09-14T09:46:11.610Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:11.609" grpc.time_ms=0.34 pid=914 span.kind=server system=grpc1661gitlab # [ 203.416876] gitaly[914]: time="2026-09-14T09:46:11.643Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:11.642" grpc.time_ms=0.276 pid=914 span.kind=server system=grpc1662gitlab # [ 203.438391] gitaly[914]: time="2026-09-14T09:46:11.664Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP diskcache=5c31b5ef-8207-4647-b810-687b0bcdb43c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:46:21.153" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:11.563" pid=914 ref=refs/keep-around/660fc8743daa5d049a1bce3c286d7cbe72049d7b remote_ip="2001:db8:1::1" revision=660fc8743daa5d049a1bce3c286d7cbe72049d7b span.kind=server system=grpc username=root1663gitlab # [ 203.438851] gitaly[914]: time="2026-09-14T09:46:11.665Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=79 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5447 command.oublock=8 command.real_time_ms=89 command.spawn_token_fork_ms=0 command.system_time_ms=54 command.user_time_ms=25 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:46:21.153" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:11.563" grpc.time_ms=101.136 pid=914 ref=refs/keep-around/660fc8743daa5d049a1bce3c286d7cbe72049d7b remote_ip="2001:db8:1::1" revision=660fc8743daa5d049a1bce3c286d7cbe72049d7b span.kind=server system=grpc username=root1664gitlab # [ 203.444525] gitaly[914]: time="2026-09-14T09:46:11.670Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:46:41.369" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:11.670" grpc.time_ms=0.667 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 203.567969] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 4931666gitlab # [ 203.569233] nixbot[2641]: {"ts": "2026-09-14T09:46:11.795Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1667gitlab # [ 203.580637] nixbot[2641]: {"ts": "2026-09-14T09:46:11.806Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-660fc8743daa-0"}1668gitlab # [ 203.746295] nixbot[2641]: {"ts": "2026-09-14T09:46:11.972Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-660fc8743daa-0", "argv0": "bwrap"}1669gitlab # [ 203.845537] systemd[1]: Started Nix Daemon.1670gitlab # [ 203.916199] nix-daemon[2799]: accepted connection from pid 2794, user nixbot1671gitlab # [ 208.062288] nix-daemon[2799]: accepted connection from pid 2841, user nixbot1672gitlab # [ 208.080635] nix-daemon[2799]: accepted connection from pid 2794, user nixbot1673gitlab # [ 212.248200] nix-daemon[2799]: accepted connection from pid 2794, user nixbot1674gitlab # [ 212.340280] nix-daemon[2799]: accepted connection from pid 2884, user nixbot1675gitlab # [ 212.394926] gitaly[914]: time="2026-09-14T09:46:20.620Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYY0DR1RVAP138GT8YSJJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:46:50.319" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:20.619" grpc.time_ms=0.735 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 212.436666] gitaly[914]: time="2026-09-14T09:46:20.663Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYY0DR1RVAP138GT8YSJJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:46:30.245" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:20.656" grpc.time_ms=6.786 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1677gitlab # [ 212.551888] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2181678gitlab # [ 212.553607] nixbot[2641]: {"ts": "2026-09-14T09:46:20.778Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1679gitlab # [ 212.631042] gitaly[914]: time="2026-09-14T09:46:20.857Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYY7PD80JN2QCFC4SGJ70 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:46:50.555" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:20.856" grpc.time_ms=0.949 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680gitlab # [ 212.677894] gitaly[914]: time="2026-09-14T09:46:20.904Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=633 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYY7PD80JN2QCFC4SGJ70 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:46:30.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:20.893" grpc.time_ms=10.838 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681gitlab # [ 212.714960] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1501682gitlab # [ 212.721588] nixbot[2641]: {"ts": "2026-09-14T09:46:20.947Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1683gitlab # [ 217.058746] nix-daemon[2799]: accepted connection from pid 2951, user nixbot1684gitlab # [ 217.152111] gitaly[914]: time="2026-09-14T09:46:25.377Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ2N4HG4CWW1BXN8Q3SZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:46:55.075" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:25.376" grpc.time_ms=0.997 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1685gitlab # [ 217.179726] gitaly[914]: time="2026-09-14T09:46:25.402Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=622 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZ2N4HG4CWW1BXN8Q3SZ4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:46:35.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:25.396" grpc.time_ms=6.284 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686gitlab # [ 217.216909] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:25 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1231687gitlab # [ 217.218451] nixbot[2641]: {"ts": "2026-09-14T09:46:25.441Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1688gitlab # [ 217.521389] gitaly[914]: time="2026-09-14T09:46:25.747Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZ30Y3XWK9C997CP3TMDR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:25.736" grpc.time_ms=10.732 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1689gitlab # [ 217.522805] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 541690gitlab # [ 217.623193] gitaly[914]: time="2026-09-14T09:46:25.849Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ33KEJ75WT166RV3AJ2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:25.842" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1691gitlab # [ 217.623641] gitaly[914]: time="2026-09-14T09:46:25.849Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ33KEJ75WT166RV3AJ2R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:25.842" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1692gitlab # [ 217.644263] gitaly[914]: time="2026-09-14T09:46:25.870Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ33KEJ75WT166RV3AJ2R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:25.842" grpc.time_ms=7.031 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1693gitlab # [ 217.657394] gitlab-workhorse[824]: time="2026-09-14T09:46:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671694gitlab # [ 217.657737] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:25 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1041695gitlab # [ 217.749960] gitaly[914]: time="2026-09-14T09:46:25.976Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZ384TJV5D9GDHZK32H6C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:25.964" grpc.time_ms=11.195 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1696gitlab # [ 217.751358] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:25 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 521697gitlab # [ 217.813426] gitaly[914]: time="2026-09-14T09:46:26.039Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ3A7ND6ZYQ5RYK2V782Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:26.032" pid=914 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc1698gitlab # [ 217.813684] gitaly[914]: time="2026-09-14T09:46:26.039Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ3A7ND6ZYQ5RYK2V782Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:26.032" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1699gitlab # [ 217.841702] gitaly[914]: time="2026-09-14T09:46:26.068Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZ3A7ND6ZYQ5RYK2V782Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:26.032" grpc.time_ms=35.535 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1700gitlab # [ 217.842137] gitlab-workhorse[824]: time="2026-09-14T09:46:26Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671701gitlab # [ 217.842793] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:26 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 761702gitlab # [ 218.830848] sidekiq-cluster[2514]: 2026-09-14T09:46:27.056Z pid=2514 tid=xve INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2514, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431624192}1703gitlab # [ 219.014756] sidekiq-cluster[2514]: W, [2026-09-14T09:46:27.240912 #2514] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1704gitlab # [ 219.056122] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:27.282Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1705gitlab # [ 221.003423] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:29.228Z","message":"GitLab reliable fetch activated!"}1706gitlab # [ 221.003946] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:29.229Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1707gitlab # [ 242.499816] postgres[3204]: [3204] ERROR: relation "table_without_models" does not exist1708gitlab # [ 242.501874] postgres[3204]: [3204] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1709gitlab # [ 243.154893] sidekiq-cluster[2514]: InitializerConnections Query: SET client_min_messages TO 'warning'1710gitlab # [ 243.156121] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1711gitlab # [ 243.156354] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1712gitlab # [ 243.157926] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1713gitlab # [ 243.159455] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1714gitlab # [ 243.160935] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1715gitlab # [ 243.162513] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1716gitlab # [ 243.164058] sidekiq-cluster[2514]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1717gitlab # [ 243.213491] sidekiq-cluster[2514]: InitializerConnections Query: SET standard_conforming_strings = on1718gitlab # [ 243.213746] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1719gitlab # [ 243.214786] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1720gitlab # [ 243.215897] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1721gitlab # [ 243.217048] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1722gitlab # [ 243.217781] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1723gitlab # [ 243.218876] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1724gitlab # [ 243.219629] sidekiq-cluster[2514]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1725gitlab # [ 243.220761] sidekiq-cluster[2514]: InitializerConnections Query: SET intervalstyle = iso_86011726gitlab # [ 243.221838] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1727gitlab # [ 243.222937] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1728gitlab # [ 243.224098] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1729gitlab # [ 243.224808] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1730gitlab # [ 243.225919] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1731gitlab # [ 243.227055] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1732gitlab # [ 243.227801] sidekiq-cluster[2514]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1733gitlab # [ 243.232732] sidekiq-cluster[2514]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname1734gitlab # [ 243.235055] sidekiq-cluster[2514]: FROM pg_type as t1735gitlab # [ 243.236131] sidekiq-cluster[2514]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz')1736gitlab # [ 243.237259] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1737gitlab # [ 243.238408] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1738gitlab # [ 243.239892] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1739gitlab # [ 243.241455] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1740gitlab # [ 243.242942] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1741gitlab # [ 243.244518] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1742gitlab # [ 243.246045] sidekiq-cluster[2514]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1743gitlab # [ 243.247318] sidekiq-cluster[2514]: InitializerConnections Query: SET SESSION timezone TO 'UTC'1744gitlab # [ 243.248430] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1745gitlab # [ 243.249875] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1746gitlab # [ 243.251438] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1747gitlab # [ 243.252898] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1748gitlab # [ 243.254450] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1749gitlab # [ 243.255910] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1750gitlab # [ 243.257455] sidekiq-cluster[2514]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1751gitlab # [ 243.258827] sidekiq-cluster[2514]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware'1752gitlab # [ 243.260089] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value'1753gitlab # [ 243.260993] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature'1754gitlab # [ 243.261949] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value'1755gitlab # [ 243.263202] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?'1756gitlab # [ 243.264111] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?'1757gitlab # [ 243.264959] sidekiq-cluster[2514]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start'1758gitlab # [ 243.265283] sidekiq-cluster[2514]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers1759gitlab # [ 245.109919] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:53.334Z","message":"Booted Rails 7.2.3.1 application in production environment"}1760gitlab # [ 245.113622] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:53.339Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [x86_64-linux]"}1761gitlab # [ 245.114951] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:53.339Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1762gitlab # [ 245.118460] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:53.339Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1763gitlab # [ 245.119536] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:53.341Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1764gitlab: (finished: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails', in 43.70 seconds)1765gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1766gitlab # [ 245.761213] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 431767gitlab # [ 245.860365] gitaly[914]: time="2026-09-14T09:46:54.086Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=642 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYN41XDGKMA61CGJMF4R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:54.073" grpc.time_ms=12.377 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1768gitlab # [ 245.889800] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:54 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 971769gitlab # Enumerating objects: 5, done.1770gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1771gitlab # Delta compression using up to 4 threads1772gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1773gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1774gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1775gitlab # [ 246.135579] gitaly[914]: time="2026-09-14T09:46:54.361Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=329 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-14T09:47:24.048" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-14T09:46:54.349" grpc.time_ms=12.191 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776gitlab # [ 246.167781] gitaly[914]: time="2026-09-14T09:46:54.392Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ duration_ms=103ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/allowed"1777gitlab # [ 246.188933] gitaly[914]: time="2026-09-14T09:46:54.415Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ duration_ms=21ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/pre_receive"1778gitlab # [ 246.189333] gitaly[914]: time="2026-09-14T09:46:54.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5312 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:54.288" grpc.time_ms=127.026 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1779gitlab # [ 246.247954] gitaly[914]: time="2026-09-14T09:46:54.474Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:54.473" grpc.time_ms=0.422 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1780gitlab # [ 246.290361] gitaly[914]: time="2026-09-14T09:46:54.516Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4781 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:54.515" grpc.time_ms=1.016 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1781gitlab # [ 246.332433] gitaly[914]: time="2026-09-14T09:46:54.558Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:54.558" grpc.time_ms=0.409 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1782gitlab # [ 246.405390] gitaly[914]: time="2026-09-14T09:46:54.631Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ duration_ms=34ns method=POST pid=914 status=200 url="http://unix/api/v4/internal/post_receive"1783gitlab # [ 246.415292] gitaly[914]: time="2026-09-14T09:46:54.632Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4806 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:54.596" grpc.time_ms=36.049 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1784gitlab # [ 246.444537] gitaly[914]: time="2026-09-14T09:46:54.670Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ diskcache=8d68e066-3a33-4d42-ad9f-5ef97be3ce83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:54.210" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1785gitlab # [ 246.453609] gitaly[914]: time="2026-09-14T09:46:54.671Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=206 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=872448 command.minflt=13735 command.oublock=32 command.real_time_ms=450 command.spawn_token_fork_ms=1 command.system_time_ms=136 command.user_time_ms=70 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:54.210" grpc.time_ms=460.711 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1786gitlab # [ 246.465557] gitlab-workhorse[824]: time="2026-09-14T09:46:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521787gitlab # [ 246.467315] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:54 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5341788gitlab # To http://gitlab/root/test-flake.git1789gitlab # 660fc87..31808a3 master -> master1790gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.82 seconds)1791gitlab: must succeed: git -C /tmp/test-flake rev-parse master1792gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'1794gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.06 seconds)1795gitlab # [ 246.548100] nixbot[2641]: INFO: ::ffff:127.0.0.1:48898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK1796gitlab # [ 246.843113] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.068Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3ccbe9ab24d8bef6e43b4a6f","created_at":"2026-09-14T09:45:59.208Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.241Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3ccbe9ab24d8bef6e43b4a6f: start","job_status":"start","queue_duration_s":55.826959,"scheduling_latency_s":55.82703}1797gitlab # [ 247.019952] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.245Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3ccbe9ab24d8bef6e43b4a6f","created_at":"2026-09-14T09:45:59.208Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.241Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3ccbe9ab24d8bef6e43b4a6f: done: 0.178151 sec","job_status":"done","queue_duration_s":55.826959,"scheduling_latency_s":55.82703,"redis_calls":23,"redis_duration_s":0.0055639999999999995,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003377,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0011,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.087937712,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.178151,"completed_at":"2026-09-14T09:46:55.245Z","load_balancing_strategy":"primary","db_duration_s":0.060805,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1798gitlab # [ 247.069846] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.246Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6a3659c5dc419f5386f7493a","created_at":"2026-09-14T09:45:59.248Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.252Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6a3659c5dc419f5386f7493a: start","job_status":"start","queue_duration_s":55.994548,"scheduling_latency_s":55.994564}1799gitlab # [ 247.119280] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.345Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6a3659c5dc419f5386f7493a","created_at":"2026-09-14T09:45:59.248Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.252Z","job_size_bytes":2,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6a3659c5dc419f5386f7493a: done: 0.098207 sec","job_status":"done","queue_duration_s":55.994548,"scheduling_latency_s":55.994564,"redis_calls":14,"redis_duration_s":0.023869,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000356,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00114,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.022373,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.05989141,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.098207,"completed_at":"2026-09-14T09:46:55.345Z","load_balancing_strategy":"primary","db_duration_s":0.018765,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1800gitlab # [ 247.161340] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.387Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6882cb42235bd129c09492a1","created_at":"2026-09-14T09:45:59.746Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.751Z","job_size_bytes":5,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6882cb42235bd129c09492a1: start","job_status":"start","queue_duration_s":55.635605,"scheduling_latency_s":55.635663}1801gitlab # [ 247.316553] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.542Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6882cb42235bd129c09492a1","created_at":"2026-09-14T09:45:59.746Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.751Z","job_size_bytes":5,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6882cb42235bd129c09492a1: done: 0.15561 sec","job_status":"done","queue_duration_s":55.635605,"scheduling_latency_s":55.635663,"redis_calls":12,"redis_duration_s":0.002114,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000647,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000219022,"duration_s":0.15561,"completed_at":"2026-09-14T09:46:55.542Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027791,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1802gitlab # [ 247.317384] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.543Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"e6be299a48c5c3d49d333626","created_at":"2026-09-14T09:45:59.773Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.776Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-e6be299a48c5c3d49d333626: start","job_status":"start","queue_duration_s":55.767305,"scheduling_latency_s":55.76732}1803gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'1804gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.03 seconds)1805gitlab # [ 247.538222] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.764Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"e6be299a48c5c3d49d333626","created_at":"2026-09-14T09:45:59.773Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.776Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-e6be299a48c5c3d49d333626: done: 0.220463 sec","job_status":"done","queue_duration_s":55.767305,"scheduling_latency_s":55.76732,"redis_calls":11,"redis_duration_s":0.0014860000000000001,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000379,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.197,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.197,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.10737,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000252546,"duration_s":0.220463,"completed_at":"2026-09-14T09:46:55.764Z","load_balancing_strategy":"primary","db_duration_s":0.115284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1806gitlab # [ 247.538992] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.765Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e4dee7a8d242161db71ceb99","created_at":"2026-09-14T09:45:59.778Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.782Z","job_size_bytes":89,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e4dee7a8d242161db71ceb99: start","job_status":"start","queue_duration_s":55.982959,"scheduling_latency_s":55.982973}1807gitlab # [ 247.615800] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.789Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"e4dee7a8d242161db71ceb99","created_at":"2026-09-14T09:45:59.778Z","trace_propagation_headers":{"sentry-trace":"87f809e9fe4748858a91bbf8d59e4e5a-0af16953609b41b6","baggage":"sentry-trace_id=87f809e9fe4748858a91bbf8d59e4e5a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMY8F50VNPFBX9NNEZWX4A","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-14T09:45:59.782Z","job_size_bytes":89,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-e4dee7a8d242161db71ceb99: done: 0.02441 sec","job_status":"done","queue_duration_s":55.982959,"scheduling_latency_s":55.982973,"redis_calls":11,"redis_duration_s":0.001353,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000359,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000225,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000286629,"duration_s":0.02441,"completed_at":"2026-09-14T09:46:55.789Z","load_balancing_strategy":"primary","db_duration_s":0.00331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1808gitlab # [ 247.631399] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.790Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 660fc8743daa5d049a1bce3c286d7cbe72049d7b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8ad81080cc172c54b593a45d","created_at":"2026-09-14T09:46:07.265Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-2668f390b6c14ee8","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:46:07.269Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8ad81080cc172c54b593a45d: start","job_status":"start","queue_duration_s":48.521652,"scheduling_latency_s":48.521664}1809gitlab # [ 247.647173] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:55.800Z","message":"changes: \"0000000000000000000000000000000000000000 660fc8743daa5d049a1bce3c286d7cbe72049d7b refs/heads/master\\n\""}1810gitlab # [ 247.649890] gitaly[914]: time="2026-09-14T09:46:55.831Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:05.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:55.825" grpc.time_ms=5.96 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 247.698077] nixbot[2641]: INFO: ::ffff:127.0.0.1:48912 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK1812gitlab # [ 247.698713] gitaly[914]: time="2026-09-14T09:46:55.839Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:47:05.014" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:55.834" grpc.time_ms=4.938 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1813gitlab # [ 247.699561] gitaly[914]: time="2026-09-14T09:46:55.892Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=638 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=15 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-14T09:47:05.050" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:55.870" grpc.time_ms=21.683 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 247.733269] gitaly[914]: time="2026-09-14T09:46:55.959Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3933 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:55.959" grpc.time_ms=0.365 pid=914 span.kind=server system=grpc1815gitlab # [ 247.760743] gitaly[914]: time="2026-09-14T09:46:55.987Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:55.986" grpc.time_ms=0.39 pid=914 span.kind=server system=grpc1816gitlab # [ 247.780617] gitaly[914]: time="2026-09-14T09:46:56.007Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 diskcache=268a3591-9501-4419-beda-9e70c9052ec9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:05.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:55.899" pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1817gitlab # [ 247.790341] gitaly[914]: time="2026-09-14T09:46:56.016Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=57 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4990 command.oublock=8 command.real_time_ms=99 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:05.079" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:55.899" grpc.time_ms=107.212 pid=914 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1818gitlab # [ 247.792118] gitaly[914]: time="2026-09-14T09:46:56.018Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:47:06.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:56.018" grpc.time_ms=0.107 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1819gitlab # [ 247.822885] gitaly[914]: time="2026-09-14T09:46:56.049Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=943 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-14T09:47:06.030" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:56.041" grpc.time_ms=7.906 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1820gitlab # [ 247.928099] gitaly[914]: time="2026-09-14T09:46:56.154Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=339 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-14T09:47:26.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:56.149" grpc.time_ms=5.018 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1821gitlab # [ 247.953259] gitaly[914]: time="2026-09-14T09:46:56.179Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T09:47:06.169" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:56.179" grpc.time_ms=0.245 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1822gitlab # [ 247.987734] gitaly[914]: time="2026-09-14T09:46:56.214Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=344 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-14T09:47:06.196" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-14T09:46:56.207" grpc.time_ms=6.76 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1823gitlab # [ 248.010355] gitaly[914]: time="2026-09-14T09:46:56.236Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:06.216" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:56.226" grpc.time_ms=10.249 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab # [ 248.024342] gitaly[914]: time="2026-09-14T09:46:56.250Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:06.233" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:56.243" grpc.time_ms=7.465 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825gitlab # [ 248.061362] gitaly[914]: time="2026-09-14T09:46:56.287Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-14T09:47:26.178" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:56.278" grpc.time_ms=9.341 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826gitlab # [ 248.506144] gitaly[914]: time="2026-09-14T09:46:56.732Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-14T09:47:06.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:56.730" grpc.time_ms=2.127 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1827gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'1828gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.04 seconds)1829gitlab # [ 248.564713] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:56.790Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 660fc8743daa5d049a1bce3c286d7cbe72049d7b refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8ad81080cc172c54b593a45d","created_at":"2026-09-14T09:46:07.265Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-2668f390b6c14ee8","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:46:07.269Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8ad81080cc172c54b593a45d: done: 0.999404 sec","job_status":"done","queue_duration_s":48.521652,"scheduling_latency_s":48.521664,"gitaly_calls":13,"gitaly_duration_s":0.292601,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.064823,"redis_read_bytes":2103,"redis_write_bytes":21748,"redis_cache_calls":15,"redis_cache_duration_s":0.004125,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.005167,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.001231,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7836,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004335,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.011811,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.038154,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.181,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.202,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.579927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000396698,"exclusive_lock_hold_duration_s":0.023094833999999998,"duration_s":0.999404,"completed_at":"2026-09-14T09:46:56.790Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088019,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1830gitlab # [ 248.611745] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:56.791Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7d4f6afedfef8ac24740794e","created_at":"2026-09-14T09:46:11.681Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.689Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7d4f6afedfef8ac24740794e: start","job_status":"start","queue_duration_s":45.102303,"scheduling_latency_s":45.102317}1831gitlab # [ 248.624997] nixbot[2641]: INFO: ::ffff:127.0.0.1:48914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK1832gitlab # [ 248.636870] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:56.862Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"7d4f6afedfef8ac24740794e","created_at":"2026-09-14T09:46:11.681Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.689Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-7d4f6afedfef8ac24740794e: done: 0.070989 sec","job_status":"done","queue_duration_s":45.102303,"scheduling_latency_s":45.102317,"redis_calls":16,"redis_duration_s":0.004481,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002559,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001496,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000429384,"duration_s":0.070989,"completed_at":"2026-09-14T09:46:56.862Z","load_balancing_strategy":"primary","db_duration_s":0.01989,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1833gitlab # [ 248.684024] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:56.864Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"05342951a13cf41cf0dac6ca","created_at":"2026-09-14T09:46:11.689Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.694Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-05342951a13cf41cf0dac6ca: start","job_status":"start","queue_duration_s":45.17042,"scheduling_latency_s":45.170446}1834gitlab # [ 248.706209] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:56.932Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"05342951a13cf41cf0dac6ca","created_at":"2026-09-14T09:46:11.689Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.694Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-05342951a13cf41cf0dac6ca: done: 0.067507 sec","job_status":"done","queue_duration_s":45.17042,"scheduling_latency_s":45.170446,"redis_calls":21,"redis_duration_s":0.004255999999999999,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.001898,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001414,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000313447,"duration_s":0.067507,"completed_at":"2026-09-14T09:46:56.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835gitlab # [ 248.711413] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:56.933Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"fbaae0ca894b3310b8ae9103","created_at":"2026-09-14T09:46:11.776Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.780Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fbaae0ca894b3310b8ae9103: start","job_status":"start","queue_duration_s":45.152678,"scheduling_latency_s":45.152692}1836gitlab # [ 248.833822] gitaly[914]: time="2026-09-14T09:46:57.059Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:57.057" grpc.time_ms=1.529 pid=914 span.kind=server system=grpc1837gitlab # [ 248.876421] gitaly[914]: time="2026-09-14T09:46:57.102Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:57.102" grpc.time_ms=0.311 pid=914 span.kind=server system=grpc1838gitlab # [ 248.919570] gitaly[914]: time="2026-09-14T09:46:57.145Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:57.145" grpc.time_ms=0.489 pid=914 span.kind=server system=grpc1839gitlab # [ 248.939621] gitaly[914]: time="2026-09-14T09:46:57.166Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP diskcache=a114c8d2-199a-4957-b7a7-4abd65efb2f9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:27.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.018" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab # [ 248.940402] gitaly[914]: time="2026-09-14T09:46:57.166Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=144 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7407 command.oublock=0 command.real_time_ms=138 command.spawn_token_fork_ms=0 command.system_time_ms=87 command.user_time_ms=57 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:27.018" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.018" grpc.time_ms=147.309 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841gitlab # [ 249.075991] gitaly[914]: time="2026-09-14T09:46:57.302Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:27.200" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.300" grpc.time_ms=1.251 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 249.119495] gitaly[914]: time="2026-09-14T09:46:57.345Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:27.244" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.344" grpc.time_ms=0.821 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1843gitlab # [ 249.133092] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.359Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"fbaae0ca894b3310b8ae9103","created_at":"2026-09-14T09:46:11.776Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.780Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2514,"job_status":"rescheduled","message":"PipelineProcessWorker JID-fbaae0ca894b3310b8ae9103: rescheduled"}1844gitlab # [ 249.142936] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.369Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"fbaae0ca894b3310b8ae9103","created_at":"2026-09-14T09:46:11.776Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-19c52270678f4c23","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:11.780Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-fbaae0ca894b3310b8ae9103: done: 0.435698 sec","job_status":"done","queue_duration_s":45.152678,"scheduling_latency_s":45.152692,"gitaly_calls":3,"gitaly_duration_s":0.17755,"redis_calls":120,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.021485,"redis_read_bytes":460,"redis_write_bytes":29292,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00071,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001576,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.007224,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":27,"redis_queues_duration_s":0.003349,"redis_queues_read_bytes":37,"redis_queues_write_bytes":15580,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.004917,"redis_queues_metadata_read_bytes":34,"redis_queues_metadata_write_bytes":3577,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000299,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00057,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00213,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199888,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.39058344,"duration_s":0.435698,"completed_at":"2026-09-14T09:46:57.369Z","load_balancing_strategy":"primary","db_duration_s":0.048256,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1845gitlab # [ 249.198798] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.370Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","660fc8743daa5d049a1bce3c286d7cbe72049d7b 31808a3c70b234eea6b1c2d00f8cdd86c33e122c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"160533c3b0b07db052dc3ac1","created_at":"2026-09-14T09:46:54.619Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-91b586a2769648fd","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:46:54.620Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-160533c3b0b07db052dc3ac1: start","job_status":"start","queue_duration_s":2.74951,"scheduling_latency_s":2.749525}1846gitlab # [ 249.199761] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.377Z","message":"changes: \"660fc8743daa5d049a1bce3c286d7cbe72049d7b 31808a3c70b234eea6b1c2d00f8cdd86c33e122c refs/heads/master\\n\""}1847gitlab # [ 249.200415] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.412Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d440005b8549b93ec996ab0a","created_at":"2026-09-14T09:46:57.410Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"eef4ec0cce9bac92b4c4bc35","job_size_bytes":46,"pid":2514,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d440005b8549b93ec996ab0a: deduplicated: until executing","deduplication.type":"until executing"}1848gitlab # [ 249.207956] gitaly[914]: time="2026-09-14T09:46:57.398Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=629 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:07.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.388" grpc.time_ms=9.596 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 249.219740] gitaly[914]: time="2026-09-14T09:46:57.409Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:47:07.020" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:57.401" grpc.time_ms=7.962 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1850gitlab # [ 249.260677] gitaly[914]: time="2026-09-14T09:46:57.426Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=641 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-14T09:47:07.039" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.420" grpc.time_ms=5.906 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1851gitlab # [ 249.261526] gitaly[914]: time="2026-09-14T09:46:57.436Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-14T09:47:27.329" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.429" grpc.time_ms=6.641 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 249.262139] gitaly[914]: time="2026-09-14T09:46:57.448Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=346 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-14T09:47:07.064" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-14T09:46:57.444" grpc.time_ms=3.889 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 249.268574] gitaly[914]: time="2026-09-14T09:46:57.459Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:07.073" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.454" grpc.time_ms=5.533 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1854gitlab # [ 249.289184] gitaly[914]: time="2026-09-14T09:46:57.515Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-14T09:47:07.134" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.514" grpc.time_ms=1.017 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1855gitlab # [ 249.301611] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.527Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","660fc8743daa5d049a1bce3c286d7cbe72049d7b 31808a3c70b234eea6b1c2d00f8cdd86c33e122c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"160533c3b0b07db052dc3ac1","created_at":"2026-09-14T09:46:54.619Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-91b586a2769648fd","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:46:54.620Z","job_size_bytes":185,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-160533c3b0b07db052dc3ac1: done: 0.157699 sec","job_status":"done","queue_duration_s":2.74951,"scheduling_latency_s":2.749525,"gitaly_calls":7,"gitaly_duration_s":0.052944,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.015666,"redis_read_bytes":501,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.002038,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.000854,"redis_queues_read_bytes":9,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002008,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.004698,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.006068,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00034334,"exclusive_lock_hold_duration_s":0.015318986,"duration_s":0.157699,"completed_at":"2026-09-14T09:46:57.527Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020332,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1856gitlab # [ 249.346442] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.529Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"eef4ec0cce9bac92b4c4bc35","created_at":"2026-09-14T09:46:55.841Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:55.855Z","job_size_bytes":46,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-eef4ec0cce9bac92b4c4bc35: start","job_status":"start","queue_duration_s":1.673491,"scheduling_latency_s":1.673508}1857gitlab # [ 249.349147] gitaly[914]: time="2026-09-14T09:46:57.567Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-14T15:46:57.561" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:46:57.561" grpc.time_ms=5.282 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1858gitlab # [ 249.396419] gitaly[914]: time="2026-09-14T09:46:57.579Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=655 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-14T09:47:27.472" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.573" grpc.time_ms=6.671 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1859gitlab # [ 249.397142] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.615Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"eef4ec0cce9bac92b4c4bc35","created_at":"2026-09-14T09:46:55.841Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:55.855Z","job_size_bytes":46,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-eef4ec0cce9bac92b4c4bc35: done: 0.086705 sec","job_status":"done","queue_duration_s":1.673491,"scheduling_latency_s":1.673508,"gitaly_calls":2,"gitaly_duration_s":0.016139,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.006982,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001311,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000594,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001565,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.002843,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044028,"duration_s":0.086705,"completed_at":"2026-09-14T09:46:57.615Z","load_balancing_strategy":"primary","db_duration_s":0.012343,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1860gitlab # [ 249.440789] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.617Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9271e3324be94c7e839585e3","created_at":"2026-09-14T09:46:55.865Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:55.868Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9271e3324be94c7e839585e3: start","job_status":"start","queue_duration_s":1.7495,"scheduling_latency_s":1.749527}1861gitlab # [ 249.441745] gitaly[914]: time="2026-09-14T09:46:57.661Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 diskcache=0bf9803f-f993-42c6-a147-e63716a37749 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T15:46:57.636" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.636" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1862gitlab # [ 249.442517] gitaly[914]: time="2026-09-14T09:46:57.661Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1290 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T15:46:57.636" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.636" grpc.time_ms=24.74 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1863gitlab # [ 249.481906] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.686Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9271e3324be94c7e839585e3","created_at":"2026-09-14T09:46:55.865Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:55.868Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9271e3324be94c7e839585e3: done: 0.069389 sec","job_status":"done","queue_duration_s":1.7495,"scheduling_latency_s":1.749527,"gitaly_calls":1,"gitaly_duration_s":0.026752,"redis_calls":15,"redis_duration_s":0.00213,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000253,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000404,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000667,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.052112490000000004,"duration_s":0.069389,"completed_at":"2026-09-14T09:46:57.686Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1864gitlab # [ 249.492894] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.688Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"b04aae4f5eb28dae0673c262","created_at":"2026-09-14T09:46:56.014Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:56.016Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b04aae4f5eb28dae0673c262: start","job_status":"start","queue_duration_s":1.671719,"scheduling_latency_s":1.671734}1865gitlab # [ 249.506889] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.717Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"b04aae4f5eb28dae0673c262","created_at":"2026-09-14T09:46:56.014Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:56.016Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-b04aae4f5eb28dae0673c262: done: 0.029564 sec","job_status":"done","queue_duration_s":1.671719,"scheduling_latency_s":1.671734,"gitaly_calls":1,"gitaly_duration_s":0.007864,"redis_calls":16,"redis_duration_s":0.002148,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000176,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.000907,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029564,"completed_at":"2026-09-14T09:46:57.717Z","load_balancing_strategy":"primary","db_duration_s":0.001507,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1866gitlab # [ 249.568957] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:57.718Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f8b56d5e050f50a5e725ec9d","created_at":"2026-09-14T09:46:56.529Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:662cb691b2015abb5a5cb9f7b8ca6827d39803bbff3728106cefd3cabfc6cdc8","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:56.532Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f8b56d5e050f50a5e725ec9d: start","job_status":"start","queue_duration_s":1.185626,"scheduling_latency_s":1.185641}1867gitlab # [ 249.569762] gitaly[914]: time="2026-09-14T09:46:57.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=652 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-14T09:47:27.604" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.705" grpc.time_ms=5.488 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868gitlab # [ 249.573738] gitaly[914]: time="2026-09-14T09:46:57.735Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:27.634" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.734" grpc.time_ms=0.391 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1869gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'1870gitlab # [ 249.585753] gitaly[914]: time="2026-09-14T09:46:57.742Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T09:47:07.017" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.738" grpc.time_ms=4.475 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1871gitlab # [ 249.597467] gitaly[914]: time="2026-09-14T09:46:57.823Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:27.722" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.822" grpc.time_ms=0.666 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1872gitlab # [ 249.641544] gitaly[914]: time="2026-09-14T09:46:57.830Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=49 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-14T09:47:27.728" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:57.828" grpc.time_ms=1.929 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1873gitlab # [ 249.661825] nixbot[2641]: INFO: ::ffff:127.0.0.1:48926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK1874gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.04 seconds)1875gitlab # [ 249.671070] gitaly[914]: time="2026-09-14T09:46:57.897Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:07.172" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:57.892" grpc.time_ms=4.904 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 250.162885] gitaly[914]: time="2026-09-14T09:46:58.388Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=965 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-14T09:47:28.271" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:58.371" grpc.time_ms=17.329 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 250.211325] gitaly[914]: time="2026-09-14T09:46:58.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=627 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYGFNJ34QBZPKC9CJ1KQ8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-14T09:47:28.321" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:58.422" grpc.time_ms=15.438 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 250.249238] sidekiq-cluster[2514]: {"severity":"WARN","time":"2026-09-14T09:46:58.475Z","class":"CreatePipelineWorker","correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"660fc8743daa5d049a1bce3c286d7cbe72049d7b","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"660fc8743daa5d049a1bce3c286d7cbe72049d7b","ref":"refs/heads/master"},"retry":0}1879gitlab # [ 250.259256] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.485Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f8b56d5e050f50a5e725ec9d","created_at":"2026-09-14T09:46:56.529Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:662cb691b2015abb5a5cb9f7b8ca6827d39803bbff3728106cefd3cabfc6cdc8","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:56.532Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f8b56d5e050f50a5e725ec9d: done: 0.766458 sec","job_status":"done","queue_duration_s":1.185626,"scheduling_latency_s":1.185641,"gitaly_calls":7,"gitaly_duration_s":0.101503,"redis_calls":51,"redis_duration_s":0.011188,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.000677,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.003655,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001032,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00476,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.613234,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000388876,"duration_s":0.766458,"completed_at":"2026-09-14T09:46:58.485Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039528,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1880gitlab # [ 250.269201] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.487Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"7bd26846-a1df-436c-9b7f-f7e8d6eb034b\"}"],"class":"WebHookWorker","jid":"55e53198e3d3e03143fe276b","created_at":"2026-09-14T09:46:56.703Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:940eb8e599dc1a4a5280dc2834ac133fe3a26575b4b43f6fa1bf8a306f9969f4","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:56.709Z","job_size_bytes":1751,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-55e53198e3d3e03143fe276b: start","job_status":"start","queue_duration_s":1.777611,"scheduling_latency_s":1.777636}1881gitlab # [ 250.369760] nixbot[2641]: INFO: ::ffff:127.0.0.1:48940 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1882gitlab # [ 250.384119] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.610Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"7bd26846-a1df-436c-9b7f-f7e8d6eb034b\"}"],"class":"WebHookWorker","jid":"55e53198e3d3e03143fe276b","created_at":"2026-09-14T09:46:56.703Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-cafee8ad24904016","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:940eb8e599dc1a4a5280dc2834ac133fe3a26575b4b43f6fa1bf8a306f9969f4","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:56.709Z","job_size_bytes":1751,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-55e53198e3d3e03143fe276b: done: 0.123289 sec","job_status":"done","queue_duration_s":1.777611,"scheduling_latency_s":1.777636,"redis_calls":19,"redis_duration_s":0.0037140000000000003,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000883,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.00038,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.03971286900002724,"cpu_s":0.07128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000302553,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.123289,"completed_at":"2026-09-14T09:46:58.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 250.433702] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.626Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a252595c55cb7efc633e6c16","created_at":"2026-09-14T09:46:57.008Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.012Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a252595c55cb7efc633e6c16: start","job_status":"start","queue_duration_s":1.614376,"scheduling_latency_s":1.614394}1884gitlab # [ 250.461700] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"a252595c55cb7efc633e6c16","created_at":"2026-09-14T09:46:57.008Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.012Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-a252595c55cb7efc633e6c16: done: 0.061483 sec","job_status":"done","queue_duration_s":1.614376,"scheduling_latency_s":1.614394,"redis_calls":10,"redis_duration_s":0.001927,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021595,"duration_s":0.061483,"completed_at":"2026-09-14T09:46:58.687Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011443,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1885gitlab # [ 250.462798] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.689Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7fe5a21208824100c9e0daa5","created_at":"2026-09-14T09:46:57.192Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.198Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7fe5a21208824100c9e0daa5: start","job_status":"start","queue_duration_s":1.490539,"scheduling_latency_s":1.490555}1886gitlab # [ 250.500888] gitaly[914]: time="2026-09-14T09:46:58.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN035XVMH4QH2066WGW4XX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.721" grpc.time_ms=5.352 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1887gitlab # [ 250.502423] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:58 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1061888gitlab # [ 250.550551] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.776Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"7fe5a21208824100c9e0daa5","created_at":"2026-09-14T09:46:57.192Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.198Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-7fe5a21208824100c9e0daa5: done: 0.087305 sec","job_status":"done","queue_duration_s":1.490539,"scheduling_latency_s":1.490555,"redis_calls":10,"redis_duration_s":0.002249,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000584,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225727,"duration_s":0.087305,"completed_at":"2026-09-14T09:46:58.776Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.062994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1889gitlab # [ 250.561673] gitaly[914]: time="2026-09-14T09:46:58.788Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0399T4VCDFG5CMDBAM97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.781" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1890gitlab # [ 250.563127] gitaly[914]: time="2026-09-14T09:46:58.788Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0399T4VCDFG5CMDBAM97 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.781" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab # [ 250.571799] gitlab-workhorse[824]: time="2026-09-14T09:46:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671892gitlab # [ 250.609811] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 591893gitlab # [ 250.610603] gitaly[914]: time="2026-09-14T09:46:58.788Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0399T4VCDFG5CMDBAM97 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.781" grpc.time_ms=6.993 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1894gitlab # [ 250.628874] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.854Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"93717a52252cc095c1636cd0","created_at":"2026-09-14T09:46:57.212Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.221Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-93717a52252cc095c1636cd0: start","job_status":"start","queue_duration_s":1.63319,"scheduling_latency_s":1.633222}1895gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'1896gitlab # [ 250.657410] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.883Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"93717a52252cc095c1636cd0","created_at":"2026-09-14T09:46:57.212Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.221Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-93717a52252cc095c1636cd0: done: 0.029075 sec","job_status":"done","queue_duration_s":1.63319,"scheduling_latency_s":1.633222,"redis_calls":10,"redis_duration_s":0.002319,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000235,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001251,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000254223,"duration_s":0.029075,"completed_at":"2026-09-14T09:46:58.883Z","load_balancing_strategy":"primary","db_duration_s":0.004088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1897gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.04 seconds)1898gitlab # [ 250.677639] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.884Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2e357d0d9d4dd0b774a90bd4","created_at":"2026-09-14T09:46:57.240Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.246Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2e357d0d9d4dd0b774a90bd4: start","job_status":"start","queue_duration_s":1.637828,"scheduling_latency_s":1.637841}1899gitlab # [ 250.678489] gitlab-workhorse[824]: time="2026-09-14T09:46:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3361900gitlab # [ 250.678905] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:58 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 991901gitlab # [ 250.679272] gitaly[914]: time="2026-09-14T09:46:58.889Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03B6VN7XFNEP21MEGCSY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.878" pid=914 remote_ip="2001:db8:1::1" request_sha=2fa7f4378e7c685a2e595c979167f1353fdf2d68 response_bytes=336 span.kind=server system=grpc1902gitlab # [ 250.683555] gitaly[914]: time="2026-09-14T09:46:58.890Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03B6VN7XFNEP21MEGCSY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.878" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 250.723693] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.915Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"2e357d0d9d4dd0b774a90bd4","created_at":"2026-09-14T09:46:57.240Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.246Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-2e357d0d9d4dd0b774a90bd4: done: 0.031103 sec","job_status":"done","queue_duration_s":1.637828,"scheduling_latency_s":1.637841,"redis_calls":13,"redis_duration_s":0.005137,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003247,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220419,"duration_s":0.031103,"completed_at":"2026-09-14T09:46:58.915Z","load_balancing_strategy":"primary","db_duration_s":0.004558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1904gitlab # [ 250.772159] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.916Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"da87a7c8ba1eb960be1309fd","created_at":"2026-09-14T09:46:57.247Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.252Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-da87a7c8ba1eb960be1309fd: start","job_status":"start","queue_duration_s":1.663885,"scheduling_latency_s":1.663899}1905gitlab # [ 250.773267] nixbot[2641]: INFO: ::ffff:127.0.0.1:48942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK1906gitlab # [ 250.773742] nixbot[2641]: {"ts": "2026-09-14T09:46:58.938Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}1907gitlab # [ 250.774248] gitaly[914]: time="2026-09-14T09:46:58.890Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1191 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03B6VN7XFNEP21MEGCSY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:58.878" grpc.time_ms=11.634 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1908gitlab # [ 250.774868] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"da87a7c8ba1eb960be1309fd","created_at":"2026-09-14T09:46:57.247Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.252Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-da87a7c8ba1eb960be1309fd: done: 0.025969 sec","job_status":"done","queue_duration_s":1.663885,"scheduling_latency_s":1.663899,"redis_calls":10,"redis_duration_s":0.0027210000000000003,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001371,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000222375,"duration_s":0.025969,"completed_at":"2026-09-14T09:46:58.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004136,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1909gitlab # [ 250.814052] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.943Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"730639c8a89a4697a582df61","created_at":"2026-09-14T09:46:57.253Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.259Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-730639c8a89a4697a582df61: start","job_status":"start","queue_duration_s":1.68463,"scheduling_latency_s":1.684646}1910gitlab # [ 250.819724] gitaly[914]: time="2026-09-14T09:46:58.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03G41NKP37MH3WAFVK96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:28.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:58.993" grpc.time_ms=0.626 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1911gitlab # [ 250.858298] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.970Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"730639c8a89a4697a582df61","created_at":"2026-09-14T09:46:57.253Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.259Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-730639c8a89a4697a582df61: done: 0.026981 sec","job_status":"done","queue_duration_s":1.68463,"scheduling_latency_s":1.684646,"redis_calls":11,"redis_duration_s":0.004619,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002945,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000282159,"duration_s":0.026981,"completed_at":"2026-09-14T09:46:58.970Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1912gitlab # [ 250.899661] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.972Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3740ac28c31ffbba445ec289","created_at":"2026-09-14T09:46:57.262Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.267Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3740ac28c31ffbba445ec289: start","job_status":"start","queue_duration_s":1.704227,"scheduling_latency_s":1.704241}1913gitlab # [ 250.900579] gitaly[914]: time="2026-09-14T09:46:59.072Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=625 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN03G41NKP37MH3WAFVK96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:09.056" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.066" grpc.time_ms=5.792 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1914gitlab # [ 250.901231] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.995Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3740ac28c31ffbba445ec289","created_at":"2026-09-14T09:46:57.262Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.267Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3740ac28c31ffbba445ec289: done: 0.023085 sec","job_status":"done","queue_duration_s":1.704227,"scheduling_latency_s":1.704241,"redis_calls":10,"redis_duration_s":0.001313,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210362,"duration_s":0.023085,"completed_at":"2026-09-14T09:46:58.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1915gitlab # [ 250.945233] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:58.996Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b039c0e8b4918dd76480656a","created_at":"2026-09-14T09:46:57.268Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.273Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b039c0e8b4918dd76480656a: start","job_status":"start","queue_duration_s":1.723099,"scheduling_latency_s":1.72313}1916gitlab # [ 250.950631] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.026Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"b039c0e8b4918dd76480656a","created_at":"2026-09-14T09:46:57.268Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.273Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-b039c0e8b4918dd76480656a: done: 0.030712 sec","job_status":"done","queue_duration_s":1.723099,"scheduling_latency_s":1.72313,"redis_calls":10,"redis_duration_s":0.003717,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000318,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000204495,"duration_s":0.030712,"completed_at":"2026-09-14T09:46:59.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00355,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1917gitlab # [ 250.997243] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.027Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4ff55f661bd843825d4486b0","created_at":"2026-09-14T09:46:57.277Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.279Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4ff55f661bd843825d4486b0: start","job_status":"start","queue_duration_s":1.748386,"scheduling_latency_s":1.7484}1918gitlab # [ 251.036421] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 1951919gitlab # [ 251.037049] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1001920gitlab # [ 251.037573] nixbot[2641]: {"ts": "2026-09-14T09:46:59.144Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1921gitlab # [ 251.038080] nixbot[2641]: {"ts": "2026-09-14T09:46:59.249Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1922gitlab # [ 251.038585] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.055Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"4ff55f661bd843825d4486b0","created_at":"2026-09-14T09:46:57.277Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.279Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-4ff55f661bd843825d4486b0: done: 0.027217 sec","job_status":"done","queue_duration_s":1.748386,"scheduling_latency_s":1.7484,"redis_calls":10,"redis_duration_s":0.001275,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000214,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000214552,"duration_s":0.027217,"completed_at":"2026-09-14T09:46:59.054Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1923gitlab # [ 251.052810] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.056Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"125c8640189c8cfd5bbc6b99","created_at":"2026-09-14T09:46:57.279Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.281Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-125c8640189c8cfd5bbc6b99: start","job_status":"start","queue_duration_s":1.774249,"scheduling_latency_s":1.774263}1924gitlab # [ 251.067099] gitaly[914]: time="2026-09-14T09:46:59.182Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03PBNV30Y64EKD4FXBRP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:29.181" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.182" grpc.time_ms=0.472 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925gitlab # [ 251.116826] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.071Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"125c8640189c8cfd5bbc6b99","created_at":"2026-09-14T09:46:57.279Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.281Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-125c8640189c8cfd5bbc6b99: done: 0.015787 sec","job_status":"done","queue_duration_s":1.774249,"scheduling_latency_s":1.774263,"redis_calls":10,"redis_duration_s":0.001327,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000286,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000232152,"duration_s":0.015787,"completed_at":"2026-09-14T09:46:59.071Z","load_balancing_strategy":"primary","db_duration_s":0.00153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1926gitlab # [ 251.118640] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.072Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f0ce58d352c131d3ba4f5d48","created_at":"2026-09-14T09:46:57.282Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.284Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f0ce58d352c131d3ba4f5d48: start","job_status":"start","queue_duration_s":1.788628,"scheduling_latency_s":1.788642}1927gitlab # [ 251.131969] gitaly[914]: time="2026-09-14T09:46:59.213Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=628 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN03PBNV30Y64EKD4FXBRP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:09.197" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.207" grpc.time_ms=5.776 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928gitlab # [ 251.171151] nixbot[2641]: {"ts": "2026-09-14T09:46:59.353Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b \"HTTP/1.1 201 Created\""}1929gitlab # [ 251.171948] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"f0ce58d352c131d3ba4f5d48","created_at":"2026-09-14T09:46:57.282Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.284Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f0ce58d352c131d3ba4f5d48: done: 0.029319 sec","job_status":"done","queue_duration_s":1.788628,"scheduling_latency_s":1.788642,"redis_calls":10,"redis_duration_s":0.0033929999999999997,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002924,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000220699,"duration_s":0.029319,"completed_at":"2026-09-14T09:46:59.102Z","load_balancing_strategy":"primary","db_duration_s":0.007564,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1930gitlab # [ 251.214866] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.103Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9e3941feeb0d234046f31707","created_at":"2026-09-14T09:46:57.289Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.291Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9e3941feeb0d234046f31707: start","job_status":"start","queue_duration_s":1.811604,"scheduling_latency_s":1.811617}1931gitlab # [ 251.215724] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:59 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/660fc8743daa5d049a1bce3c286d7cbe72049d7b HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1001932gitlab # [ 251.216119] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:59 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 431933gitlab # [ 251.216957] gitaly[914]: time="2026-09-14T09:46:59.287Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03SM8J7E5WBV0W3E09KQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:29.286" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.287" grpc.time_ms=0.643 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934gitlab # [ 251.217601] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.153Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9e3941feeb0d234046f31707","created_at":"2026-09-14T09:46:57.289Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.291Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9e3941feeb0d234046f31707: done: 0.04988 sec","job_status":"done","queue_duration_s":1.811604,"scheduling_latency_s":1.811617,"redis_calls":14,"redis_duration_s":0.001974,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00024,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000859,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000263441,"duration_s":0.04988,"completed_at":"2026-09-14T09:46:59.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1935gitlab # [ 251.260292] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.154Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"62b116e248075b893f983d31","created_at":"2026-09-14T09:46:57.359Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.361Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-62b116e248075b893f983d31: start","job_status":"start","queue_duration_s":1.792555,"scheduling_latency_s":1.79257}1936gitlab # [ 251.261709] gitaly[914]: time="2026-09-14T09:46:59.315Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN03SM8J7E5WBV0W3E09KQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:09.298" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.308" grpc.time_ms=6.877 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937gitlab # [ 251.273296] gitlab-workhorse[824]: time="2026-09-14T09:46:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671938gitlab # [ 251.275090] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:46:59 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 391939gitlab # [ 251.312041] gitaly[914]: time="2026-09-14T09:46:59.420Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN03XHVT1K3MRV1PWEA10Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:59.412" grpc.time_ms=8.171 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1940gitlab # [ 251.312698] gitaly[914]: time="2026-09-14T09:46:59.460Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03YYN2D8Z7S97E4TZ9M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:59.454" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1941gitlab # [ 251.313489] gitaly[914]: time="2026-09-14T09:46:59.460Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03YYN2D8Z7S97E4TZ9M6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:59.454" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1942gitlab # [ 251.314093] gitaly[914]: time="2026-09-14T09:46:59.461Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=637 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN03YYN2D8Z7S97E4TZ9M6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:46:59.454" grpc.time_ms=6.178 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1943gitlab # [ 251.353645] gitaly[914]: time="2026-09-14T09:46:59.512Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:59.512" grpc.time_ms=0.349 pid=914 span.kind=server system=grpc1944gitlab # [ 251.354200] gitaly[914]: time="2026-09-14T09:46:59.533Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:59.532" grpc.time_ms=0.267 pid=914 span.kind=server system=grpc1945gitlab # [ 251.354876] gitaly[914]: time="2026-09-14T09:46:59.552Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:46:59.551" grpc.time_ms=0.32 pid=914 span.kind=server system=grpc1946gitlab # [ 251.355596] gitaly[914]: time="2026-09-14T09:46:59.561Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP diskcache=8f14e601-66fd-4a31-a93f-831b4a61b6fe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:29.113" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.213" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1947gitlab # [ 251.356200] gitaly[914]: time="2026-09-14T09:46:59.562Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=85 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=6990 command.oublock=0 command.real_time_ms=341 command.spawn_token_fork_ms=1 command.system_time_ms=51 command.user_time_ms=34 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:29.113" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.213" grpc.time_ms=348.63 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1948gitlab # [ 251.398927] gitaly[914]: time="2026-09-14T09:46:59.597Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:29.496" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.596" grpc.time_ms=0.624 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 251.399663] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.622Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"613c46e0fd4310bb1b3dfd01","created_at":"2026-09-14T09:46:59.621Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"62b116e248075b893f983d31","job_size_bytes":3,"pid":2514,"job_status":"deduplicated","message":"PipelineProcessWorker JID-613c46e0fd4310bb1b3dfd01: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}1950gitlab # [ 251.400413] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.624Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"62b116e248075b893f983d31","created_at":"2026-09-14T09:46:57.359Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.361Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2514,"job_status":"rescheduled","message":"PipelineProcessWorker JID-62b116e248075b893f983d31: rescheduled"}1951gitlab # [ 251.403149] gitaly[914]: time="2026-09-14T09:46:59.617Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:29.516" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.616" grpc.time_ms=0.468 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 251.414804] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.628Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"62b116e248075b893f983d31","created_at":"2026-09-14T09:46:57.359Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-93b79503352c41d5","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.361Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-62b116e248075b893f983d31: done: 0.47451 sec","job_status":"done","queue_duration_s":1.792555,"scheduling_latency_s":1.79257,"gitaly_calls":3,"gitaly_duration_s":0.3548,"redis_calls":69,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010702,"redis_read_bytes":231,"redis_write_bytes":18463,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000351,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000562,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.001885,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":22,"redis_queues_metadata_duration_s":0.003048,"redis_queues_metadata_read_bytes":110,"redis_queues_metadata_write_bytes":3546,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000198,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000346,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.003961,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09162,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.443866469,"duration_s":0.47451,"completed_at":"2026-09-14T09:46:59.628Z","load_balancing_strategy":"primary","db_duration_s":0.023311,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1953gitlab # [ 251.460345] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.629Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4c3e5a20fee540690e5305dc","created_at":"2026-09-14T09:46:57.416Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"9271e3324be94c7e839585e3","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.417Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4c3e5a20fee540690e5305dc: start","job_status":"start","queue_duration_s":2.212433,"scheduling_latency_s":2.212448}1954gitlab # [ 251.500839] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.665Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"4c3e5a20fee540690e5305dc","created_at":"2026-09-14T09:46:57.416Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"9271e3324be94c7e839585e3","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.417Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-4c3e5a20fee540690e5305dc: done: 0.035359 sec","job_status":"done","queue_duration_s":2.212433,"scheduling_latency_s":2.212448,"gitaly_calls":1,"gitaly_duration_s":0.012001,"redis_calls":12,"redis_duration_s":0.001769,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000369,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.022570746,"duration_s":0.035359,"completed_at":"2026-09-14T09:46:59.665Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1955gitlab # [ 251.515110] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:46:59.666Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f2595b342397dc44f5e79939","created_at":"2026-09-14T09:46:57.492Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c0dbaba7682915120ef3a0efa76a881ff0425ae0c028383caf511f08febaf95e","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.493Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f2595b342397dc44f5e79939: start","job_status":"start","queue_duration_s":2.17253,"scheduling_latency_s":2.172545}1956gitlab # [ 251.530711] gitaly[914]: time="2026-09-14T09:46:59.651Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ diskcache=f82da54f-5d03-403f-8207-557adc47bc42 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T15:46:59.640" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.641" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1957gitlab # [ 251.570698] gitaly[914]: time="2026-09-14T09:46:59.651Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-14T15:46:59.640" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.641" grpc.time_ms=10.501 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 251.571656] gitaly[914]: time="2026-09-14T09:46:59.682Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:29.581" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.682" grpc.time_ms=0.554 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1959gitlab # [ 251.572536] gitaly[914]: time="2026-09-14T09:46:59.690Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T09:47:09.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.684" grpc.time_ms=5.974 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1960gitlab # [ 251.573176] gitaly[914]: time="2026-09-14T09:46:59.714Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:29.713" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.713" grpc.time_ms=0.56 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961gitlab # [ 251.583911] gitaly[914]: time="2026-09-14T09:46:59.719Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=38 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-14T09:47:29.717" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:46:59.717" grpc.time_ms=1.64 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 251.598752] gitaly[914]: time="2026-09-14T09:46:59.741Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=631 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:09.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:46:59.735" grpc.time_ms=5.43 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'1964gitlab # [ 251.758890] nixbot[2641]: INFO: ::ffff:127.0.0.1:48956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.06 seconds)1966gitlab # [ 251.932751] gitaly[914]: time="2026-09-14T09:47:00.159Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=962 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-14T09:47:30.140" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:00.141" grpc.time_ms=18.038 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1967gitlab # [ 251.949529] gitaly[914]: time="2026-09-14T09:47:00.175Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=630 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M2FMZYSRDWK0N2HF73XT6HJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-14T09:47:30.161" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:00.161" grpc.time_ms=14.034 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1968gitlab # [ 251.969424] sidekiq-cluster[2514]: {"severity":"WARN","time":"2026-09-14T09:47:00.195Z","class":"CreatePipelineWorker","correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"660fc8743daa5d049a1bce3c286d7cbe72049d7b","after":"31808a3c70b234eea6b1c2d00f8cdd86c33e122c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"31808a3c70b234eea6b1c2d00f8cdd86c33e122c","ref":"refs/heads/master"},"retry":0}1969gitlab # [ 251.977745] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.203Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f2595b342397dc44f5e79939","created_at":"2026-09-14T09:46:57.492Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c0dbaba7682915120ef3a0efa76a881ff0425ae0c028383caf511f08febaf95e","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.493Z","job_size_bytes":467,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f2595b342397dc44f5e79939: done: 0.536662 sec","job_status":"done","queue_duration_s":2.17253,"scheduling_latency_s":2.172545,"gitaly_calls":7,"gitaly_duration_s":0.060095,"redis_calls":33,"redis_duration_s":0.004439,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000388,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.001874,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.454117,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.536662,"completed_at":"2026-09-14T09:47:00.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016032,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1970gitlab # [ 252.020803] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.206Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"440e8a6e-6bf5-4f9f-957c-3018bfb45202\"}"],"class":"WebHookWorker","jid":"c02491ceacd89a23708185b7","created_at":"2026-09-14T09:46:57.504Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5edc7a8e55813d53ba090d5a1d41cadae32509fca43c5a03d9ecf5da165861ec","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.505Z","job_size_bytes":1749,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c02491ceacd89a23708185b7: start","job_status":"start","queue_duration_s":2.700739,"scheduling_latency_s":2.700774}1971gitlab # [ 252.022047] nixbot[2641]: INFO: ::ffff:127.0.0.1:48958 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1972gitlab # [ 252.026213] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.252Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"440e8a6e-6bf5-4f9f-957c-3018bfb45202\"}"],"class":"WebHookWorker","jid":"c02491ceacd89a23708185b7","created_at":"2026-09-14T09:46:57.504Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-e8b3ec7434ad4c8a","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5edc7a8e55813d53ba090d5a1d41cadae32509fca43c5a03d9ecf5da165861ec","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.505Z","job_size_bytes":1749,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-c02491ceacd89a23708185b7: done: 0.046084 sec","job_status":"done","queue_duration_s":2.700739,"scheduling_latency_s":2.700774,"redis_calls":14,"redis_duration_s":0.003108,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.00077,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001423,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.009378566000009414,"cpu_s":0.027783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.046084,"completed_at":"2026-09-14T09:47:00.252Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1973gitlab # [ 252.081169] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.253Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"eca56127d8a68a6c766fdd1c","created_at":"2026-09-14T09:46:57.594Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-283946c15ead439c","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.600Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-eca56127d8a68a6c766fdd1c: start","job_status":"start","queue_duration_s":2.652936,"scheduling_latency_s":2.652956}1974gitlab # [ 252.081758] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.286Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"eca56127d8a68a6c766fdd1c","created_at":"2026-09-14T09:46:57.594Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-283946c15ead439c","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:57.600Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-eca56127d8a68a6c766fdd1c: done: 0.033101 sec","job_status":"done","queue_duration_s":2.652936,"scheduling_latency_s":2.652956,"redis_calls":19,"redis_duration_s":0.002438,"redis_read_bytes":22,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000326,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001145,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.004861511,"duration_s":0.033101,"completed_at":"2026-09-14T09:47:00.286Z","load_balancing_strategy":"primary","db_duration_s":0.005033,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1975gitlab # [ 252.120595] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.287Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","55e53198e3d3e03143fe276b"],"class":"WebHooks::LogExecutionWorker","jid":"57e67c725fe6b7d5923c46e8","created_at":"2026-09-14T09:46:58.598Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-3caf079a04534c43","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:076989b4535daeb6626c9bba647720fff39e0fdc208e6589763bf937e7a52cb2","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:58.604Z","job_size_bytes":2593,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-57e67c725fe6b7d5923c46e8: start","job_status":"start","queue_duration_s":1.683671,"scheduling_latency_s":1.683685}1976gitlab # [ 252.122603] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.327Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","55e53198e3d3e03143fe276b"],"class":"WebHooks::LogExecutionWorker","jid":"57e67c725fe6b7d5923c46e8","created_at":"2026-09-14T09:46:58.598Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-3caf079a04534c43","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:076989b4535daeb6626c9bba647720fff39e0fdc208e6589763bf937e7a52cb2","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:58.604Z","job_size_bytes":2593,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-57e67c725fe6b7d5923c46e8: done: 0.040008 sec","job_status":"done","queue_duration_s":1.683671,"scheduling_latency_s":1.683685,"redis_calls":10,"redis_duration_s":0.0020959999999999998,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000423,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000212597,"duration_s":0.040008,"completed_at":"2026-09-14T09:47:00.327Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006336,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab # [ 252.167668] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.328Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9de95e198228db0c28fc4c53","created_at":"2026-09-14T09:46:59.207Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.209Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9de95e198228db0c28fc4c53: start","job_status":"start","queue_duration_s":1.119722,"scheduling_latency_s":1.119737}1978gitlab # [ 252.177929] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9de95e198228db0c28fc4c53","created_at":"2026-09-14T09:46:59.207Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.209Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9de95e198228db0c28fc4c53: done: 0.028031 sec","job_status":"done","queue_duration_s":1.119722,"scheduling_latency_s":1.119737,"redis_calls":7,"redis_duration_s":0.000985,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019879,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028031,"completed_at":"2026-09-14T09:47:00.356Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005234,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1979gitlab # [ 252.226953] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.357Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0ba5b6b6da356e292ba83dd2","created_at":"2026-09-14T09:46:59.567Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.569Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0ba5b6b6da356e292ba83dd2: start","job_status":"start","queue_duration_s":0.788466,"scheduling_latency_s":0.788482}1980gitlab # [ 252.265753] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.374Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"0ba5b6b6da356e292ba83dd2","created_at":"2026-09-14T09:46:59.567Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.569Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-0ba5b6b6da356e292ba83dd2: done: 0.016572 sec","job_status":"done","queue_duration_s":0.788466,"scheduling_latency_s":0.788482,"redis_calls":7,"redis_duration_s":0.000911,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016572,"completed_at":"2026-09-14T09:47:00.374Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1981gitlab # [ 252.304952] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.375Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"779c779ee9221ccaed48917c","created_at":"2026-09-14T09:46:59.573Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.574Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-779c779ee9221ccaed48917c: start","job_status":"start","queue_duration_s":0.800549,"scheduling_latency_s":0.800563}1982gitlab # [ 252.305662] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.392Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"779c779ee9221ccaed48917c","created_at":"2026-09-14T09:46:59.573Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.574Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-779c779ee9221ccaed48917c: done: 0.01702 sec","job_status":"done","queue_duration_s":0.800549,"scheduling_latency_s":0.800563,"redis_calls":7,"redis_duration_s":0.000862,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01702,"completed_at":"2026-09-14T09:47:00.392Z","load_balancing_strategy":"primary","db_duration_s":0.00263,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1983gitlab # [ 252.319870] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.393Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"016b77af703dfc3929caecc2","created_at":"2026-09-14T09:46:59.579Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.581Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-016b77af703dfc3929caecc2: start","job_status":"start","queue_duration_s":0.812185,"scheduling_latency_s":0.812199}1984gitlab # [ 252.333893] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.413Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"016b77af703dfc3929caecc2","created_at":"2026-09-14T09:46:59.579Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.581Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-016b77af703dfc3929caecc2: done: 0.020303 sec","job_status":"done","queue_duration_s":0.812185,"scheduling_latency_s":0.812199,"redis_calls":10,"redis_duration_s":0.001388,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000399,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020303,"completed_at":"2026-09-14T09:47:00.413Z","load_balancing_strategy":"primary","db_duration_s":0.004074,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985gitlab # [ 252.406107] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.414Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"420c8e22867174f7e2a05823","created_at":"2026-09-14T09:46:59.581Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.582Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-420c8e22867174f7e2a05823: start","job_status":"start","queue_duration_s":0.832158,"scheduling_latency_s":0.832173}1986gitlab # [ 252.406861] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.430Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"420c8e22867174f7e2a05823","created_at":"2026-09-14T09:46:59.581Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.582Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-420c8e22867174f7e2a05823: done: 0.015625 sec","job_status":"done","queue_duration_s":0.832158,"scheduling_latency_s":0.832173,"redis_calls":7,"redis_duration_s":0.0009519999999999999,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000239,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015625,"completed_at":"2026-09-14T09:47:00.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002387,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1987gitlab # [ 252.454404] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.431Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1f3daff396d6fd2939d899b9","created_at":"2026-09-14T09:46:59.582Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.584Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1f3daff396d6fd2939d899b9: start","job_status":"start","queue_duration_s":0.84711,"scheduling_latency_s":0.847124}1988gitlab # [ 252.455134] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.451Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1f3daff396d6fd2939d899b9","created_at":"2026-09-14T09:46:59.582Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.584Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1f3daff396d6fd2939d899b9: done: 0.020438 sec","job_status":"done","queue_duration_s":0.84711,"scheduling_latency_s":0.847124,"redis_calls":8,"redis_duration_s":0.0015769999999999998,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000396,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020438,"completed_at":"2026-09-14T09:47:00.451Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1989gitlab # [ 252.496402] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.452Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"14aee62c63c2a4b6e39b0cb4","created_at":"2026-09-14T09:46:59.584Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.585Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-14aee62c63c2a4b6e39b0cb4: start","job_status":"start","queue_duration_s":0.867043,"scheduling_latency_s":0.867063}1990gitlab # [ 252.497066] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.467Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"14aee62c63c2a4b6e39b0cb4","created_at":"2026-09-14T09:46:59.584Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.585Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-14aee62c63c2a4b6e39b0cb4: done: 0.014916 sec","job_status":"done","queue_duration_s":0.867043,"scheduling_latency_s":0.867063,"redis_calls":7,"redis_duration_s":0.001131,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014916,"completed_at":"2026-09-14T09:47:00.467Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 252.555262] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.468Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2e81f21c099ed6fa18263e31","created_at":"2026-09-14T09:46:59.585Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.587Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2e81f21c099ed6fa18263e31: start","job_status":"start","queue_duration_s":0.881151,"scheduling_latency_s":0.881164}1992gitlab # [ 252.556055] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.487Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"2e81f21c099ed6fa18263e31","created_at":"2026-09-14T09:46:59.585Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.587Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-2e81f21c099ed6fa18263e31: done: 0.018567 sec","job_status":"done","queue_duration_s":0.881151,"scheduling_latency_s":0.881164,"redis_calls":7,"redis_duration_s":0.0009209999999999999,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000663,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018567,"completed_at":"2026-09-14T09:47:00.487Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005452,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1993gitlab # [ 252.586214] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.488Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5bce44784bc2b31957957b8d","created_at":"2026-09-14T09:46:59.587Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.588Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5bce44784bc2b31957957b8d: start","job_status":"start","queue_duration_s":0.899691,"scheduling_latency_s":0.899705}1994gitlab # [ 252.633126] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.497Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5bce44784bc2b31957957b8d","created_at":"2026-09-14T09:46:59.587Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.588Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5bce44784bc2b31957957b8d: done: 0.009261 sec","job_status":"done","queue_duration_s":0.899691,"scheduling_latency_s":0.899705,"redis_calls":7,"redis_duration_s":0.0011819999999999999,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.005816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.009261,"completed_at":"2026-09-14T09:47:00.497Z","load_balancing_strategy":"primary","db_duration_s":0.000271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1995gitlab # [ 252.637239] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ab0cb9a91bb4f3b83458f463","created_at":"2026-09-14T09:46:59.588Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.589Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ab0cb9a91bb4f3b83458f463: start","job_status":"start","queue_duration_s":0.908975,"scheduling_latency_s":0.908989}1996gitlab # [ 252.684348] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.516Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"ab0cb9a91bb4f3b83458f463","created_at":"2026-09-14T09:46:59.588Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.589Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-ab0cb9a91bb4f3b83458f463: done: 0.017996 sec","job_status":"done","queue_duration_s":0.908975,"scheduling_latency_s":0.908989,"redis_calls":7,"redis_duration_s":0.001275,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00037,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017996,"completed_at":"2026-09-14T09:47:00.516Z","load_balancing_strategy":"primary","db_duration_s":0.002375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 252.687758] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:00.517Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"67b1d6841facedc8aa5f8180","created_at":"2026-09-14T09:46:59.624Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.625Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-67b1d6841facedc8aa5f8180: start","job_status":"start","queue_duration_s":0.892757,"scheduling_latency_s":0.89278}1998gitlab # [ 252.748159] gitaly[914]: time="2026-09-14T09:47:00.974Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=635 command.oublock=0 command.real_time_ms=657 command.spawn_token_fork_ms=654 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FN04SDSTKGHHWY15EM4T26 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:00.316" grpc.time_ms=658.044 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc1999gitlab # [ 252.748613] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:00 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 7042000gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'2001gitlab # [ 252.780982] gitaly[914]: time="2026-09-14T09:47:01.006Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:01.005" grpc.time_ms=0.538 pid=914 span.kind=server system=grpc2002gitlab # [ 252.805748] nixbot[2641]: INFO: ::ffff:127.0.0.1:48966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.04 seconds)2004gitlab # [ 252.810601] gitaly[914]: time="2026-09-14T09:47:01.037Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:01.036" grpc.time_ms=0.286 pid=914 span.kind=server system=grpc2005gitlab # [ 252.814250] gitaly[914]: time="2026-09-14T09:47:01.040Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05FG9VDA10XAR78JWACG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.030" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2006gitlab # [ 252.815185] gitaly[914]: time="2026-09-14T09:47:01.040Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05FG9VDA10XAR78JWACG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.030" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2007gitlab # [ 252.815904] gitlab-workhorse[824]: time="2026-09-14T09:47:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672008gitlab # [ 252.816548] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 652009gitlab # [ 252.817160] gitaly[914]: time="2026-09-14T09:47:01.041Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=640 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05FG9VDA10XAR78JWACG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.030" grpc.time_ms=10.791 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2010gitlab # [ 252.874094] gitaly[914]: time="2026-09-14T09:47:01.100Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:01.099" grpc.time_ms=0.354 pid=914 span.kind=server system=grpc2011gitlab # [ 252.882984] gitaly[914]: time="2026-09-14T09:47:01.109Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=626 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN05JAWE6FVPSEMZ0DW0EG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.102" grpc.time_ms=6.969 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2012gitlab # [ 252.883937] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:01 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 432013gitlab # [ 252.904962] gitaly[914]: time="2026-09-14T09:47:01.131Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP diskcache=e58e6d38-a7ee-4fce-9287-382aefd47acd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:30.968" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:00.968" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014gitlab # [ 252.914167] gitaly[914]: time="2026-09-14T09:47:01.140Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=72 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7219 command.oublock=0 command.real_time_ms=156 command.spawn_token_fork_ms=0 command.system_time_ms=50 command.user_time_ms=22 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:30.968" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:00.968" grpc.time_ms=162.859 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015gitlab # [ 252.935677] gitaly[914]: time="2026-09-14T09:47:01.162Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05KQ0MT6JTENF1EDM8V9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.151" pid=914 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2016gitlab # [ 252.945215] gitaly[914]: time="2026-09-14T09:47:01.162Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05KQ0MT6JTENF1EDM8V9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.151" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2017gitlab # [ 252.945547] gitlab-workhorse[824]: time="2026-09-14T09:47:01Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162018gitlab # [ 252.945985] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:01 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 512019gitlab # [ 252.946667] gitaly[914]: time="2026-09-14T09:47:01.162Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1169 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05KQ0MT6JTENF1EDM8V9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:01.151" grpc.time_ms=11.186 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2020gitlab # [ 252.958625] gitaly[914]: time="2026-09-14T09:47:01.185Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:31.184" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:01.184" grpc.time_ms=0.637 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2021gitlab # [ 252.979611] gitaly[914]: time="2026-09-14T09:47:01.206Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FMYMZ3EZ85QGXANF2DZ9VP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:31.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:01.205" grpc.time_ms=0.421 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2022gitlab # [ 252.992391] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.218Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"67b1d6841facedc8aa5f8180","created_at":"2026-09-14T09:46:59.624Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-55bb147844cb432b","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-14T09:46:59.625Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-67b1d6841facedc8aa5f8180: done: 0.700348 sec","job_status":"done","queue_duration_s":0.892757,"scheduling_latency_s":0.89278,"gitaly_calls":3,"gitaly_duration_s":0.580663,"redis_calls":64,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010010999999999999,"redis_read_bytes":144,"redis_write_bytes":16806,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000514,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000607,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":20,"redis_queues_duration_s":0.002162,"redis_queues_read_bytes":23,"redis_queues_write_bytes":11227,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.003243,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000368,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00057,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002033,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091023,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.672983857,"duration_s":0.700348,"completed_at":"2026-09-14T09:47:01.218Z","load_balancing_strategy":"primary","db_duration_s":0.021085,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2023gitlab # [ 253.034445] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.219Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c02491ceacd89a23708185b7"],"class":"WebHooks::LogExecutionWorker","jid":"03469a3e9612ae9fd12ac68d","created_at":"2026-09-14T09:47:00.244Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-de63c53adb144f77","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3a4bd0508a419154cd97425915ba6ac8812fe9df0f8b44411f4b5864124dbae8","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:00.246Z","job_size_bytes":2592,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-03469a3e9612ae9fd12ac68d: start","job_status":"start","queue_duration_s":0.97297,"scheduling_latency_s":0.97299}2024gitlab # [ 253.035079] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.238Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","c02491ceacd89a23708185b7"],"class":"WebHooks::LogExecutionWorker","jid":"03469a3e9612ae9fd12ac68d","created_at":"2026-09-14T09:47:00.244Z","trace_propagation_headers":{"sentry-trace":"5552431f3b3846ccbc7c05cceb8fd127-de63c53adb144f77","baggage":"sentry-trace_id=5552431f3b3846ccbc7c05cceb8fd127,sentry-release=Unknown"},"correlation_id":"01M2FMZYSRDWK0N2HF73XT6HJZ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:3a4bd0508a419154cd97425915ba6ac8812fe9df0f8b44411f4b5864124dbae8","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:00.246Z","job_size_bytes":2592,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-03469a3e9612ae9fd12ac68d: done: 0.018594 sec","job_status":"done","queue_duration_s":0.97297,"scheduling_latency_s":0.97299,"redis_calls":7,"redis_duration_s":0.00092,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000661,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018594,"completed_at":"2026-09-14T09:47:01.238Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2025gitlab # [ 253.075328] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.240Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"8ec4492266865c05b73ccc2b","created_at":"2026-09-14T09:47:00.277Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-0875690a10604088","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:00.281Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-8ec4492266865c05b73ccc2b: start","job_status":"start","queue_duration_s":0.958755,"scheduling_latency_s":0.958768}2026gitlab # [ 253.075950] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.299Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"8ec4492266865c05b73ccc2b","created_at":"2026-09-14T09:47:00.277Z","trace_propagation_headers":{"sentry-trace":"9966615bcb184b63a58b6036640eab79-0875690a10604088","baggage":"sentry-trace_id=9966615bcb184b63a58b6036640eab79,sentry-release=Unknown"},"correlation_id":"01M2FMYGFNJ34QBZPKC9CJ1KQ8","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:00.281Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-8ec4492266865c05b73ccc2b: done: 0.059887 sec","job_status":"done","queue_duration_s":0.958755,"scheduling_latency_s":0.958768,"redis_calls":11,"redis_duration_s":0.001638,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001114,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000210921,"duration_s":0.059887,"completed_at":"2026-09-14T09:47:01.299Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014391,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2027gitlab # [ 253.114892] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.301Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"268ccf452abdbf6fa9133478","created_at":"2026-09-14T09:47:00.560Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:00.561Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-268ccf452abdbf6fa9133478: start","job_status":"start","queue_duration_s":0.739348,"scheduling_latency_s":0.739363}2028gitlab # [ 253.122900] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.327Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"268ccf452abdbf6fa9133478","created_at":"2026-09-14T09:47:00.560Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:00.561Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-268ccf452abdbf6fa9133478: done: 0.026499 sec","job_status":"done","queue_duration_s":0.739348,"scheduling_latency_s":0.739363,"redis_calls":7,"redis_duration_s":0.000993,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026499,"completed_at":"2026-09-14T09:47:01.327Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004817,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2029gitlab # [ 253.161258] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.328Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"af9911006107776be2b5b1bb","created_at":"2026-09-14T09:47:01.146Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.148Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-af9911006107776be2b5b1bb: start","job_status":"start","queue_duration_s":0.180281,"scheduling_latency_s":0.180296}2030gitlab # [ 253.175844] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.346Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"af9911006107776be2b5b1bb","created_at":"2026-09-14T09:47:01.146Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.148Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-af9911006107776be2b5b1bb: done: 0.017318 sec","job_status":"done","queue_duration_s":0.180281,"scheduling_latency_s":0.180296,"redis_calls":7,"redis_duration_s":0.000995,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000727,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017318,"completed_at":"2026-09-14T09:47:01.346Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 253.225656] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.347Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"aac1b1ad6c788b98a23647b1","created_at":"2026-09-14T09:47:01.156Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.159Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-aac1b1ad6c788b98a23647b1: start","job_status":"start","queue_duration_s":0.187593,"scheduling_latency_s":0.187608}2032gitlab # [ 253.228578] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.364Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"aac1b1ad6c788b98a23647b1","created_at":"2026-09-14T09:47:01.156Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.159Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-aac1b1ad6c788b98a23647b1: done: 0.017434 sec","job_status":"done","queue_duration_s":0.187593,"scheduling_latency_s":0.187608,"redis_calls":7,"redis_duration_s":0.000913,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000254,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017434,"completed_at":"2026-09-14T09:47:01.364Z","load_balancing_strategy":"primary","db_duration_s":0.003226,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2033gitlab # [ 253.292702] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.365Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"cf612f5d8eaf776a54fb617a","created_at":"2026-09-14T09:47:01.166Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.168Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cf612f5d8eaf776a54fb617a: start","job_status":"start","queue_duration_s":0.197409,"scheduling_latency_s":0.197424}2034gitlab # [ 253.293423] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.384Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"cf612f5d8eaf776a54fb617a","created_at":"2026-09-14T09:47:01.166Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.168Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cf612f5d8eaf776a54fb617a: done: 0.019379 sec","job_status":"done","queue_duration_s":0.197409,"scheduling_latency_s":0.197424,"redis_calls":10,"redis_duration_s":0.001567,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000388,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019379,"completed_at":"2026-09-14T09:47:01.384Z","load_balancing_strategy":"primary","db_duration_s":0.002777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2035gitlab # [ 253.356109] gitaly[914]: time="2026-09-14T09:47:01.475Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:31.172" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:01.474" grpc.time_ms=0.521 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2036gitlab # [ 253.356956] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.385Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"84eb478b138407f06b162be3","created_at":"2026-09-14T09:47:01.168Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.169Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-84eb478b138407f06b162be3: start","job_status":"start","queue_duration_s":0.215884,"scheduling_latency_s":0.215897}2037gitlab # [ 253.357576] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.401Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"84eb478b138407f06b162be3","created_at":"2026-09-14T09:47:01.168Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.169Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-84eb478b138407f06b162be3: done: 0.015215 sec","job_status":"done","queue_duration_s":0.215884,"scheduling_latency_s":0.215897,"redis_calls":7,"redis_duration_s":0.000975,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015215,"completed_at":"2026-09-14T09:47:01.401Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2038gitlab # [ 253.414083] gitaly[914]: time="2026-09-14T09:47:01.488Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=650 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-14T09:47:31.180" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:01.481" grpc.time_ms=6.838 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2039gitlab # [ 253.414898] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.401Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6431d89b7e8f1476789f6a8e","created_at":"2026-09-14T09:47:01.170Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.171Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6431d89b7e8f1476789f6a8e: start","job_status":"start","queue_duration_s":0.230136,"scheduling_latency_s":0.23015}2040gitlab # [ 253.415474] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.416Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"6431d89b7e8f1476789f6a8e","created_at":"2026-09-14T09:47:01.170Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.171Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-6431d89b7e8f1476789f6a8e: done: 0.014432 sec","job_status":"done","queue_duration_s":0.230136,"scheduling_latency_s":0.23015,"redis_calls":8,"redis_duration_s":0.001133,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000868,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014432,"completed_at":"2026-09-14T09:47:01.416Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2041gitlab # [ 253.468863] gitaly[914]: time="2026-09-14T09:47:01.497Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:11.081" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:01.491" grpc.time_ms=5.115 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042gitlab # [ 253.469971] nixbot[2641]: {"ts": "2026-09-14T09:47:01.665Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c \"HTTP/1.1 201 Created\""}2043gitlab # [ 253.470650] nixbot[2641]: {"ts": "2026-09-14T09:47:01.672Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-31808a3c70b2-5"}2044gitlab # [ 253.471112] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.417Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f12b13b25cea467ac59bee58","created_at":"2026-09-14T09:47:01.172Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.173Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f12b13b25cea467ac59bee58: start","job_status":"start","queue_duration_s":0.243841,"scheduling_latency_s":0.243855}2045gitlab # [ 253.479733] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.431Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f12b13b25cea467ac59bee58","created_at":"2026-09-14T09:47:01.172Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.173Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f12b13b25cea467ac59bee58: done: 0.014239 sec","job_status":"done","queue_duration_s":0.243841,"scheduling_latency_s":0.243855,"redis_calls":7,"redis_duration_s":0.000982,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014239,"completed_at":"2026-09-14T09:47:01.431Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2046gitlab # [ 253.522616] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 2282047gitlab # [ 253.523232] gitaly[914]: time="2026-09-14T09:47:01.509Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T09:47:11.099" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.509" grpc.time_ms=0.185 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048gitlab # [ 253.564433] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.432Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"244c59a3ccd0c29102afe6d2","created_at":"2026-09-14T09:47:01.173Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.174Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-244c59a3ccd0c29102afe6d2: start","job_status":"start","queue_duration_s":0.257776,"scheduling_latency_s":0.257789}2049gitlab # [ 253.566784] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.450Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"244c59a3ccd0c29102afe6d2","created_at":"2026-09-14T09:47:01.173Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.174Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-244c59a3ccd0c29102afe6d2: done: 0.017935 sec","job_status":"done","queue_duration_s":0.257776,"scheduling_latency_s":0.257789,"redis_calls":7,"redis_duration_s":0.00174,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017935,"completed_at":"2026-09-14T09:47:01.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2050gitlab # [ 253.590447] nixbot[2641]: {"ts": "2026-09-14T09:47:01.767Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-31808a3c70b2-5", "argv0": "bwrap"}2051gitlab # [ 253.591201] gitaly[914]: time="2026-09-14T09:47:01.516Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=618 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T09:47:11.101" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:01.511" grpc.time_ms=4.902 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2052gitlab # [ 253.629725] gitaly[914]: time="2026-09-14T09:47:01.543Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4150 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:01.542" grpc.time_ms=0.52 pid=914 span.kind=server system=grpc2053gitlab # [ 253.630619] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.452Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5f2fca8bd627b06306263dd3","created_at":"2026-09-14T09:47:01.174Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.176Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5f2fca8bd627b06306263dd3: start","job_status":"start","queue_duration_s":0.275884,"scheduling_latency_s":0.275927}2054gitlab # [ 253.631447] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.466Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"5f2fca8bd627b06306263dd3","created_at":"2026-09-14T09:47:01.174Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.176Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-5f2fca8bd627b06306263dd3: done: 0.014973 sec","job_status":"done","queue_duration_s":0.275884,"scheduling_latency_s":0.275927,"redis_calls":7,"redis_duration_s":0.002908,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014973,"completed_at":"2026-09-14T09:47:01.466Z","load_balancing_strategy":"primary","db_duration_s":0.000288,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 253.677754] gitaly[914]: time="2026-09-14T09:47:01.563Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:01.563" grpc.time_ms=0.269 pid=914 span.kind=server system=grpc2056gitlab # [ 253.678557] gitaly[914]: time="2026-09-14T09:47:01.567Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:11.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.517" operations="[repack_refs]" pid=914 ref=refs/keep-around/31808a3c70b234eea6b1c2d00f8cdd86c33e122c remote_ip="2001:db8:1::1" revision=31808a3c70b234eea6b1c2d00f8cdd86c33e122c span.kind=server system=grpc username=root2057gitlab # [ 253.679178] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"467bcd56043718e300c9d053","created_at":"2026-09-14T09:47:01.176Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.177Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-467bcd56043718e300c9d053: start","job_status":"start","queue_duration_s":0.290968,"scheduling_latency_s":0.290983}2058gitlab # [ 253.687793] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"467bcd56043718e300c9d053","created_at":"2026-09-14T09:47:01.176Z","trace_propagation_headers":{"sentry-trace":"93d649e6e252438f98820c51c98e0806-6cf6fc7597324c5c","baggage":"sentry-trace_id=93d649e6e252438f98820c51c98e0806,sentry-release=Unknown"},"correlation_id":"01M2FMYMZ3EZ85QGXANF2DZ9VP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.177Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-467bcd56043718e300c9d053: done: 0.018577 sec","job_status":"done","queue_duration_s":0.290968,"scheduling_latency_s":0.290983,"redis_calls":7,"redis_duration_s":0.001255,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018577,"completed_at":"2026-09-14T09:47:01.486Z","load_balancing_strategy":"primary","db_duration_s":0.003372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2059gitlab # [ 253.734248] gitaly[914]: time="2026-09-14T09:47:01.568Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:11.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.517" pid=914 ref=refs/keep-around/31808a3c70b234eea6b1c2d00f8cdd86c33e122c remote_ip="2001:db8:1::1" repository_info="{false {6 702 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-09-14 09:45:59.093085412 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" revision=31808a3c70b234eea6b1c2d00f8cdd86c33e122c span.kind=server system=grpc username=root2060gitlab # [ 253.735858] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.586Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"46727becedfa4feb8cc72dc4","created_at":"2026-09-14T09:47:01.578Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-02600c47e2504780","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.581Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-46727becedfa4feb8cc72dc4: start","job_status":"start","queue_duration_s":0.005377,"scheduling_latency_s":0.005412}2061gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c'2062gitlab # [ 253.777866] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.611Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"46727becedfa4feb8cc72dc4","created_at":"2026-09-14T09:47:01.578Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-02600c47e2504780","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.581Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-46727becedfa4feb8cc72dc4: done: 0.025456 sec","job_status":"done","queue_duration_s":0.005377,"scheduling_latency_s":0.005412,"redis_calls":7,"redis_duration_s":0.002084,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025456,"completed_at":"2026-09-14T09:47:01.611Z","load_balancing_strategy":"primary","db_duration_s":0.004209,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2063gitlab # [ 253.788337] gitaly[914]: time="2026-09-14T09:47:01.572Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH diskcache=084aa3e7-dae6-436d-98e7-1bc16b2558a4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:11.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.517" pid=914 ref=refs/keep-around/31808a3c70b234eea6b1c2d00f8cdd86c33e122c remote_ip="2001:db8:1::1" revision=31808a3c70b234eea6b1c2d00f8cdd86c33e122c span.kind=server system=grpc username=root2064gitlab # [ 253.827770] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.612Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"90407c214f4130dc544310c9","created_at":"2026-09-14T09:47:01.581Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-02600c47e2504780","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.583Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-90407c214f4130dc544310c9: start","job_status":"start","queue_duration_s":0.029813,"scheduling_latency_s":0.029829}2065gitlab # [ 253.828497] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.714Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"90407c214f4130dc544310c9","created_at":"2026-09-14T09:47:01.581Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-02600c47e2504780","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.583Z","job_size_bytes":65,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-90407c214f4130dc544310c9: done: 0.101506 sec","job_status":"done","queue_duration_s":0.029813,"scheduling_latency_s":0.029829,"redis_calls":10,"redis_duration_s":0.004782,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101506,"completed_at":"2026-09-14T09:47:01.714Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009686,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2066gitlab # [ 253.867382] gitaly[914]: time="2026-09-14T09:47:01.572Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=52 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5719 command.oublock=8 command.real_time_ms=50 command.spawn_token_fork_ms=0 command.system_time_ms=38 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:11.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.517" grpc.time_ms=55.091 pid=914 ref=refs/keep-around/31808a3c70b234eea6b1c2d00f8cdd86c33e122c remote_ip="2001:db8:1::1" revision=31808a3c70b234eea6b1c2d00f8cdd86c33e122c span.kind=server system=grpc username=root2067gitlab # [ 253.868078] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.718Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e5dd0f2a62d729a5ea26c401","created_at":"2026-09-14T09:47:01.652Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-02600c47e2504780","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.655Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e5dd0f2a62d729a5ea26c401: start","job_status":"start","queue_duration_s":0.063334,"scheduling_latency_s":0.063368}2068gitlab # [ 253.876518] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.835Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e5dd0f2a62d729a5ea26c401","created_at":"2026-09-14T09:47:01.652Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-02600c47e2504780","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.655Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e5dd0f2a62d729a5ea26c401: done: 0.117435 sec","job_status":"done","queue_duration_s":0.063334,"scheduling_latency_s":0.063368,"gitaly_calls":2,"gitaly_duration_s":0.004926,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008119,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002551,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000704,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000198,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000196,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000291,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065475,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09280118,"duration_s":0.117435,"completed_at":"2026-09-14T09:47:01.835Z","load_balancing_strategy":"primary","db_duration_s":0.040862,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2069gitlab # [ 253.921131] gitaly[914]: time="2026-09-14T09:47:01.576Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:31.275" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:01.576" grpc.time_ms=0.286 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 253.958702] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.836Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c5dafc4c6475566f48b1d97e","created_at":"2026-09-14T09:47:01.769Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-13d6459b30ca49fd","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.770Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c5dafc4c6475566f48b1d97e: start","job_status":"start","queue_duration_s":0.066165,"scheduling_latency_s":0.06618}2071gitlab # [ 253.959545] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:01.858Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"c5dafc4c6475566f48b1d97e","created_at":"2026-09-14T09:47:01.769Z","trace_propagation_headers":{"sentry-trace":"87d65a5f11b8496495d605c1787eb0cc-13d6459b30ca49fd","baggage":"sentry-trace_id=87d65a5f11b8496495d605c1787eb0cc,sentry-release=Unknown"},"correlation_id":"01M2FN05XVH7D8KD0082RVRCVH","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:01.770Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-c5dafc4c6475566f48b1d97e: done: 0.021903 sec","job_status":"done","queue_duration_s":0.066165,"scheduling_latency_s":0.06618,"redis_calls":7,"redis_duration_s":0.001039,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021903,"completed_at":"2026-09-14T09:47:01.858Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2072gitlab # [ 254.012830] gitaly[914]: time="2026-09-14T09:47:01.585Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:11.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.517" pid=914 ref=refs/keep-around/31808a3c70b234eea6b1c2d00f8cdd86c33e122c remote_ip="2001:db8:1::1" revision=31808a3c70b234eea6b1c2d00f8cdd86c33e122c span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2073gitlab # [ 254.013734] gitaly[914]: time="2026-09-14T09:47:01.586Z" level=info msg="optimized repository" clean_stale_data_time=17.16531ms clean_work_trees_time="79.619µs" commit_graph_time="3.632µs" correlation_id=01M2FN05XVH7D8KD0082RVRCVH gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="4.191µs" pid=914 prune_time="3.632µs" relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="4.47µs" storage_name=default system=housekeeping total_time=17.359189ms2074gitlab # [ 254.014524] gitaly[914]: time="2026-09-14T09:47:01.586Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:47:11.107" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:47:01.517" pid=914 ref=refs/keep-around/31808a3c70b234eea6b1c2d00f8cdd86c33e122c remote_ip="2001:db8:1::1" revision=31808a3c70b234eea6b1c2d00f8cdd86c33e122c span.kind=server system=grpc username=root2075gitlab # [ 254.015167] gitaly[914]: time="2026-09-14T09:47:01.782Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:31.780" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:01.781" grpc.time_ms=0.775 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 254.021767] gitaly[914]: time="2026-09-14T09:47:01.827Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN05XVH7D8KD0082RVRCVH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:31.827" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:01.827" grpc.time_ms=0.46 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 254.089637] nixbot[2641]: INFO: ::ffff:127.0.0.1:32802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 200 OK2078gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=31808a3c70b234eea6b1c2d00f8cdd86c33e122c', in 0.29 seconds)2079(finished: subtest: push delivers the webhook, in 52.14 seconds)2080subtest: eval and build post commit statuses2081gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses2082gitlab # [ 254.145602] nix-daemon[2799]: accepted connection from pid 3665, user nixbot2083gitlab # [ 254.176103] gitaly[914]: time="2026-09-14T09:47:02.402Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN06TFZ7HQKVA8M80M7NT9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:32.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:02.401" grpc.time_ms=0.594 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 254.207491] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 812085gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses, in 0.11 seconds)2086gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses2087gitlab # [ 255.314338] gitaly[914]: time="2026-09-14T09:47:03.539Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN07XH2FY2BH3C41SZ0PTY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:33.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:03.538" grpc.time_ms=1.014 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2088gitlab # [ 255.348666] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1002089gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses, in 0.14 seconds)2090gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses2091gitlab # [ 256.414194] gitaly[914]: time="2026-09-14T09:47:04.639Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN090Y8TK3TRSGF8J7E9GG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:34.638" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:04.639" grpc.time_ms=0.629 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2092gitlab # [ 256.442390] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 612093gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses, in 0.09 seconds)2094gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses2095gitlab # [ 257.567980] gitaly[914]: time="2026-09-14T09:47:05.794Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0A3EJTYABJYPTF8MVF2W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:35.492" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:05.793" grpc.time_ms=0.82 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 257.629147] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1442097gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses, in 0.18 seconds)2098gitlab # [ 258.275218] nix-daemon[2799]: accepted connection from pid 3702, user nixbot2099gitlab # [ 258.285671] nix-daemon[2799]: accepted connection from pid 3665, user nixbot2100gitlab # [ 258.357594] gitaly[914]: time="2026-09-14T09:47:06.583Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:36.282" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:06.583" grpc.time_ms=0.697 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 258.403756] gitaly[914]: time="2026-09-14T09:47:06.630Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:16.208" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:06.618" grpc.time_ms=11.315 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 258.447406] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:06.672Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0c6dc4d42e7396fcb677e083","created_at":"2026-09-14T09:47:06.666Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-8459758598f643eb","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.670Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0c6dc4d42e7396fcb677e083: start","job_status":"start","queue_duration_s":0.001967,"scheduling_latency_s":0.002019}2103gitlab # [ 258.473280] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 1442104gitlab # [ 258.474217] nixbot[2641]: {"ts": "2026-09-14T09:47:06.691Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c \"HTTP/1.1 201 Created\""}2105gitlab # [ 258.506654] gitaly[914]: time="2026-09-14T09:47:06.732Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0B2879Q3J22N9JQ8DEXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:36.431" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:06.732" grpc.time_ms=0.742 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 258.553165] gitaly[914]: time="2026-09-14T09:47:06.779Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=624 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0B2879Q3J22N9JQ8DEXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:16.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:06.772" grpc.time_ms=7.217 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 258.594911] gitaly[914]: time="2026-09-14T09:47:06.820Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:06.820" grpc.time_ms=0.393 pid=914 span.kind=server system=grpc2108gitlab # [ 258.604581] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1342109gitlab # [ 258.605510] nixbot[2641]: {"ts": "2026-09-14T09:47:06.831Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c \"HTTP/1.1 201 Created\""}2110gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses2111gitlab # [ 258.635480] gitaly[914]: time="2026-09-14T09:47:06.861Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:06.861" grpc.time_ms=0.474 pid=914 span.kind=server system=grpc2112gitlab # [ 258.663395] gitaly[914]: time="2026-09-14T09:47:06.889Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:06.889" grpc.time_ms=0.355 pid=914 span.kind=server system=grpc2113gitlab # [ 258.674636] gitaly[914]: time="2026-09-14T09:47:06.900Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0B6XAN5Y4KJBHNF20DP4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:36.588" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:06.888" grpc.time_ms=12.07 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 258.694376] gitaly[914]: time="2026-09-14T09:47:06.920Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 diskcache=c6207f93-2d40-410f-9cd9-15f1967b4c43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:36.798" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:06.799" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2115gitlab # [ 258.694770] gitaly[914]: time="2026-09-14T09:47:06.921Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=110 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7249 command.oublock=0 command.real_time_ms=115 command.spawn_token_fork_ms=0 command.system_time_ms=82 command.user_time_ms=28 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:36.798" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:06.799" grpc.time_ms=121.827 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2116gitlab # [ 258.719463] gitaly[914]: time="2026-09-14T09:47:06.945Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0B8941VGE8CTQX94N6XY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:36.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:06.945" grpc.time_ms=0.559 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 258.719878] gitaly[914]: time="2026-09-14T09:47:06.945Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=620 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0B6XAN5Y4KJBHNF20DP4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:47:16.088" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:06.938" grpc.time_ms=7.453 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2118gitlab # [ 258.744285] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses HTTP/1.1" 200 1313 "" "curl/8.21.0" 802119gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses, in 0.11 seconds)2120gitlab # [ 258.769315] gitaly[914]: time="2026-09-14T09:47:06.995Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:36.094" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:06.994" grpc.time_ms=0.73 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 258.783860] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1642122gitlab # [ 258.784877] nixbot[2641]: {"ts": "2026-09-14T09:47:07.011Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31808a3c70b234eea6b1c2d00f8cdd86c33e122c \"HTTP/1.1 201 Created\""}2123gitlab # [ 258.794975] gitaly[914]: time="2026-09-14T09:47:07.021Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:37.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:07.020" grpc.time_ms=0.441 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 258.802463] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.028Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e111e0ed756da2a09ce1d351","created_at":"2026-09-14T09:47:07.027Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"0c6dc4d42e7396fcb677e083","job_size_bytes":3,"pid":2514,"job_status":"deduplicated","message":"PipelineProcessWorker JID-e111e0ed756da2a09ce1d351: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2125gitlab # [ 258.803541] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.029Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0c6dc4d42e7396fcb677e083","created_at":"2026-09-14T09:47:06.666Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-8459758598f643eb","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.670Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2514,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0c6dc4d42e7396fcb677e083: rescheduled"}2126gitlab # [ 258.808318] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.034Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0c6dc4d42e7396fcb677e083","created_at":"2026-09-14T09:47:06.666Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-8459758598f643eb","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.670Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0c6dc4d42e7396fcb677e083: done: 0.361801 sec","job_status":"done","queue_duration_s":0.001967,"scheduling_latency_s":0.002019,"gitaly_calls":3,"gitaly_duration_s":0.148206,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.023642,"redis_read_bytes":239,"redis_write_bytes":21782,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001279,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000999,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.002765,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14467,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.015246,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000323,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000353,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001398,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.024,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142874,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.309668128,"duration_s":0.361801,"completed_at":"2026-09-14T09:47:07.034Z","load_balancing_strategy":"primary","db_duration_s":0.049079,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2127gitlab # [ 258.850719] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.035Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9693bd27cd7c382bc102b821","created_at":"2026-09-14T09:47:06.779Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.793Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9693bd27cd7c382bc102b821: start","job_status":"start","queue_duration_s":0.242159,"scheduling_latency_s":0.242196}2128gitlab # [ 258.851484] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9693bd27cd7c382bc102b821","created_at":"2026-09-14T09:47:06.779Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.793Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9693bd27cd7c382bc102b821: done: 0.028324 sec","job_status":"done","queue_duration_s":0.242159,"scheduling_latency_s":0.242196,"redis_calls":7,"redis_duration_s":0.00097,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028324,"completed_at":"2026-09-14T09:47:07.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005057,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2129gitlab # [ 258.907672] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.064Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"922c82b7be3bccefd395c22d","created_at":"2026-09-14T09:47:06.946Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.948Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-922c82b7be3bccefd395c22d: start","job_status":"start","queue_duration_s":0.116543,"scheduling_latency_s":0.11656}2130gitlab # [ 258.908239] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.083Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"922c82b7be3bccefd395c22d","created_at":"2026-09-14T09:47:06.946Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.948Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-922c82b7be3bccefd395c22d: done: 0.018317 sec","job_status":"done","queue_duration_s":0.116543,"scheduling_latency_s":0.11656,"redis_calls":7,"redis_duration_s":0.000947,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018317,"completed_at":"2026-09-14T09:47:07.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2131gitlab # [ 258.952103] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.084Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bbb48a4ec188b516d0097731","created_at":"2026-09-14T09:47:06.954Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.956Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bbb48a4ec188b516d0097731: start","job_status":"start","queue_duration_s":0.127311,"scheduling_latency_s":0.127325}2132gitlab # [ 258.952853] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.103Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"bbb48a4ec188b516d0097731","created_at":"2026-09-14T09:47:06.954Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.956Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-bbb48a4ec188b516d0097731: done: 0.019358 sec","job_status":"done","queue_duration_s":0.127311,"scheduling_latency_s":0.127325,"redis_calls":7,"redis_duration_s":0.001134,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000819,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000315,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019358,"completed_at":"2026-09-14T09:47:07.103Z","load_balancing_strategy":"primary","db_duration_s":0.003363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2133gitlab # [ 259.000590] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.104Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"17328f9db8f589ed096a5d87","created_at":"2026-09-14T09:47:06.964Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.965Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-17328f9db8f589ed096a5d87: start","job_status":"start","queue_duration_s":0.139321,"scheduling_latency_s":0.139337}2134gitlab # [ 259.001238] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.130Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"17328f9db8f589ed096a5d87","created_at":"2026-09-14T09:47:06.964Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.965Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-17328f9db8f589ed096a5d87: done: 0.025538 sec","job_status":"done","queue_duration_s":0.139321,"scheduling_latency_s":0.139337,"redis_calls":10,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00044,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000336,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025538,"completed_at":"2026-09-14T09:47:07.130Z","load_balancing_strategy":"primary","db_duration_s":0.00484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2135gitlab # [ 259.064875] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.131Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b1eb92b1326e9df4a915d670","created_at":"2026-09-14T09:47:06.965Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.967Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b1eb92b1326e9df4a915d670: start","job_status":"start","queue_duration_s":0.164355,"scheduling_latency_s":0.164374}2136gitlab # [ 259.065682] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.164Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"b1eb92b1326e9df4a915d670","created_at":"2026-09-14T09:47:06.965Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:99ba93e701690c3a10a017e4f432c18103a4ebef8dca1f80d289f0d8d281ddbd","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.967Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-b1eb92b1326e9df4a915d670: done: 0.03333 sec","job_status":"done","queue_duration_s":0.164355,"scheduling_latency_s":0.164374,"redis_calls":7,"redis_duration_s":0.00281,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001238,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03333,"completed_at":"2026-09-14T09:47:07.164Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 259.116083] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.166Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0e513d1d1c49e022762cdcfd","created_at":"2026-09-14T09:47:06.967Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.968Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0e513d1d1c49e022762cdcfd: start","job_status":"start","queue_duration_s":0.19721,"scheduling_latency_s":0.197233}2138gitlab # [ 259.116372] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.190Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0e513d1d1c49e022762cdcfd","created_at":"2026-09-14T09:47:06.967Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:cfc6cb7e9ac589948d38cba01bc2474abdf1c3f286e44c45fd4f7315244498f9","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.968Z","job_size_bytes":19,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0e513d1d1c49e022762cdcfd: done: 0.024748 sec","job_status":"done","queue_duration_s":0.19721,"scheduling_latency_s":0.197233,"redis_calls":8,"redis_duration_s":0.003837,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003058,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012292,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024748,"completed_at":"2026-09-14T09:47:07.190Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 259.139206] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.192Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"58300d9c48659d2f396a19c5","created_at":"2026-09-14T09:47:06.969Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.973Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-58300d9c48659d2f396a19c5: start","job_status":"start","queue_duration_s":0.218232,"scheduling_latency_s":0.21825}2140gitlab # [ 259.177686] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.209Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e2, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"58300d9c48659d2f396a19c5","created_at":"2026-09-14T09:47:06.969Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e6b1af094efc47a22f7a765ff4de932873f6cdeb518f26c41b5526619631b5bd","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.973Z","job_size_bytes":66,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-58300d9c48659d2f396a19c5: done: 0.017044 sec","job_status":"done","queue_duration_s":0.218232,"scheduling_latency_s":0.21825,"redis_calls":7,"redis_duration_s":0.0009519999999999999,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000256,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017044,"completed_at":"2026-09-14T09:47:07.209Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001943,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2141gitlab # [ 259.218149] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"27db9197ef7ad1bd3df3ab52","created_at":"2026-09-14T09:47:06.975Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.977Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-27db9197ef7ad1bd3df3ab52: start","job_status":"start","queue_duration_s":0.233338,"scheduling_latency_s":0.233355}2142gitlab # [ 259.218805] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.243Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"27db9197ef7ad1bd3df3ab52","created_at":"2026-09-14T09:47:06.975Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.977Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-27db9197ef7ad1bd3df3ab52: done: 0.033339 sec","job_status":"done","queue_duration_s":0.233338,"scheduling_latency_s":0.233355,"redis_calls":7,"redis_duration_s":0.001304,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033339,"completed_at":"2026-09-14T09:47:07.243Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2143gitlab # [ 259.262966] gitaly[914]: time="2026-09-14T09:47:07.438Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:07.437" grpc.time_ms=0.392 pid=914 span.kind=server system=grpc2144gitlab # [ 259.263699] gitaly[914]: time="2026-09-14T09:47:07.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=632 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0BRDPSHBRQQBA833KAV3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.442" grpc.time_ms=8.077 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2145gitlab # [ 259.264462] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 452146gitlab # [ 259.264965] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.245Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"1aaaab7bb56956ce28a94858","created_at":"2026-09-14T09:47:06.981Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.982Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1aaaab7bb56956ce28a94858: start","job_status":"start","queue_duration_s":0.26257,"scheduling_latency_s":0.262591}2147gitlab # [ 259.302776] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.265Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"Ci::PipelineFinishedWorker","jid":"1aaaab7bb56956ce28a94858","created_at":"2026-09-14T09:47:06.981Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0a7c1b70389f5450c4d99f719cfa84d9d157db429a8cf22b1d3be2bf77e33077","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.982Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-1aaaab7bb56956ce28a94858: done: 0.020671 sec","job_status":"done","queue_duration_s":0.26257,"scheduling_latency_s":0.262591,"redis_calls":7,"redis_duration_s":0.001032,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020671,"completed_at":"2026-09-14T09:47:07.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 259.343435] gitaly[914]: time="2026-09-14T09:47:07.503Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0BSW9JJFMHW3JVT4N359 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.493" pid=914 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2149gitlab # [ 259.344096] gitlab-workhorse[824]: time="2026-09-14T09:47:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672150gitlab # [ 259.344549] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 522151gitlab # [ 259.345435] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.266Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8620836547fd7a38f77738d6","created_at":"2026-09-14T09:47:06.982Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.984Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8620836547fd7a38f77738d6: start","job_status":"start","queue_duration_s":0.282794,"scheduling_latency_s":0.282812}2152gitlab # [ 259.346486] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"8620836547fd7a38f77738d6","created_at":"2026-09-14T09:47:06.982Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.984Z","job_size_bytes":6,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-8620836547fd7a38f77738d6: done: 0.010697 sec","job_status":"done","queue_duration_s":0.282794,"scheduling_latency_s":0.282812,"redis_calls":7,"redis_duration_s":0.000957,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.006522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.010697,"completed_at":"2026-09-14T09:47:07.277Z","load_balancing_strategy":"primary","db_duration_s":0.00025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2153gitlab # [ 259.404092] gitaly[914]: time="2026-09-14T09:47:07.503Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0BSW9JJFMHW3JVT4N359 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.493" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2154gitlab # [ 259.404818] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 472155gitlab # [ 259.405420] gitlab-workhorse[824]: time="2026-09-14T09:47:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672156gitlab # [ 259.405843] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 462157gitlab # [ 259.406516] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.278Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d37f4b212a772223630b47b4","created_at":"2026-09-14T09:47:06.984Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.985Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d37f4b212a772223630b47b4: start","job_status":"start","queue_duration_s":0.293044,"scheduling_latency_s":0.293059}2158gitlab # [ 259.407085] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.296Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"d37f4b212a772223630b47b4","created_at":"2026-09-14T09:47:06.984Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:06.985Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-d37f4b212a772223630b47b4: done: 0.017746 sec","job_status":"done","queue_duration_s":0.293044,"scheduling_latency_s":0.293059,"redis_calls":7,"redis_duration_s":0.001206,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000341,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017746,"completed_at":"2026-09-14T09:47:07.296Z","load_balancing_strategy":"primary","db_duration_s":0.002544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2159gitlab # [ 259.452625] gitaly[914]: time="2026-09-14T09:47:07.503Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=645 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0BSW9JJFMHW3JVT4N359 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.493" grpc.time_ms=10.356 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2160gitlab # [ 259.453803] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.297Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e92a072bfeab6d7ed5112454","created_at":"2026-09-14T09:47:07.030Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:07.030Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e92a072bfeab6d7ed5112454: start","job_status":"start","queue_duration_s":0.266411,"scheduling_latency_s":0.266429}2161gitlab # [ 259.491689] gitaly[914]: time="2026-09-14T09:47:07.579Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=634 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0BWB1NTQ3SXCX01150X0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.571" grpc.time_ms=7.938 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2162gitlab # [ 259.492083] gitaly[914]: time="2026-09-14T09:47:07.627Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0BXWNAE18JMJRR8GN0N8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.620" pid=914 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2163gitlab # [ 259.492772] gitaly[914]: time="2026-09-14T09:47:07.627Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0BXWNAE18JMJRR8GN0N8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.620" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2164gitlab # [ 259.493326] gitaly[914]: time="2026-09-14T09:47:07.627Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=636 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=1 command.user_time_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0BXWNAE18JMJRR8GN0N8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:47:07.620" grpc.time_ms=6.896 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc2165gitlab # [ 259.568162] gitaly[914]: time="2026-09-14T09:47:07.794Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3892 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:07.794" grpc.time_ms=0.346 pid=914 span.kind=server system=grpc2166gitlab # [ 259.599064] gitaly[914]: time="2026-09-14T09:47:07.824Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:47:07.823" grpc.time_ms=0.48 pid=914 span.kind=server system=grpc2167gitlab # [ 259.615442] gitaly[914]: time="2026-09-14T09:47:07.841Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 diskcache=5a339252-4fea-4bca-b3f5-c61933e1b010 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:37.351" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:07.351" pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2168gitlab # [ 259.616218] gitaly[914]: time="2026-09-14T09:47:07.842Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=83 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=819200 command.minflt=6813 command.oublock=0 command.real_time_ms=483 command.spawn_token_fork_ms=0 command.system_time_ms=56 command.user_time_ms=27 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-14T09:47:37.351" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:47:07.351" grpc.time_ms=490.544 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2169gitlab # [ 259.668165] gitaly[914]: time="2026-09-14T09:47:07.894Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-14T09:47:37.893" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:07.893" grpc.time_ms=0.798 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2170gitlab # [ 259.711704] gitaly[914]: time="2026-09-14T09:47:07.938Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0AXH9FV4QS0SR046Y6R5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:37.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:07.937" grpc.time_ms=0.815 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses2172gitlab # [ 259.745932] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.971Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"e92a072bfeab6d7ed5112454","created_at":"2026-09-14T09:47:07.030Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-369c8e1656e741a7","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:07.030Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e92a072bfeab6d7ed5112454: done: 0.67426 sec","job_status":"done","queue_duration_s":0.266411,"scheduling_latency_s":0.266429,"gitaly_calls":3,"gitaly_duration_s":0.500542,"redis_calls":65,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.022879,"redis_read_bytes":144,"redis_write_bytes":16877,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000319,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001645,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":20,"redis_queues_duration_s":0.002854,"redis_queues_read_bytes":21,"redis_queues_write_bytes":11226,"redis_queues_metadata_calls":18,"redis_queues_metadata_duration_s":0.014545,"redis_queues_metadata_read_bytes":28,"redis_queues_metadata_write_bytes":2886,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000156,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000915,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002126,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118405,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.624640562,"duration_s":0.67426,"completed_at":"2026-09-14T09:47:07.971Z","load_balancing_strategy":"primary","db_duration_s":0.032836,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2173gitlab # [ 259.757670] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:07.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6c844ad008c96cf5d279aeb1","created_at":"2026-09-14T09:47:07.345Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-1f6df3e2a0234beb","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:07.346Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6c844ad008c96cf5d279aeb1: start","job_status":"start","queue_duration_s":0.628297,"scheduling_latency_s":0.628333}2174gitlab # [ 259.879238] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:08.105Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6c844ad008c96cf5d279aeb1","created_at":"2026-09-14T09:47:07.345Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-1f6df3e2a0234beb","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:07.346Z","job_size_bytes":23,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6c844ad008c96cf5d279aeb1: done: 0.130121 sec","job_status":"done","queue_duration_s":0.628297,"scheduling_latency_s":0.628333,"redis_calls":7,"redis_duration_s":0.004664,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.130121,"completed_at":"2026-09-14T09:47:08.105Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059676,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2175gitlab # [ 259.925882] sidekiq-cluster[2514]: {"severity":"INFO","time":"2026-09-14T09:47:08.151Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"8357be9aa8e2cb5a9bf9d28d","created_at":"2026-09-14T09:47:07.850Z","trace_propagation_headers":{"sentry-trace":"08935fc46bc243cd866352a6cfc6bfa7-1f6df3e2a0234beb","baggage":"sentry-trace_id=08935fc46bc243cd866352a6cfc6bfa7,sentry-release=Unknown"},"correlation_id":"01M2FN0AXH9FV4QS0SR046Y6R5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-09-14T09:47:07.854Z","job_size_bytes":3,"pid":2514,"sidekiq_tid":"m7y2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-8357be9aa8e2cb5a9bf9d28d: start","job_status":"start","queue_duration_s":0.297258,"scheduling_latency_s":0.297301}2176gitlab # [ 259.961721] gitaly[914]: time="2026-09-14T09:47:08.188Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FN0CD64DT09FTT4ZQX50Y3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:47:38.186" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:47:08.186" grpc.time_ms=0.9 pid=914 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2177gitlab # [ 259.996897] gitlab-workhorse[824]: gitlab 2001:db8:1::1 - - [2026/09/14:09:47:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1522178gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/31808a3c70b234eea6b1c2d00f8cdd86c33e122c/statuses, in 0.25 seconds)2179(finished: subtest: eval and build post commit statuses, in 5.91 seconds)2180(finished: run the VM test script, in 310.27 seconds)2181test script finished in 310.30s2182cleanup2183kill QemuMachine (pid 46)2184gitlab # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/gxzhl7aaiid7zp3y47jqqiq7zg5mqpwp-python3-3.14.6/bin/python3.14)2185(finished: cleanup, in 1.42 seconds)2186additionally exposed symbols:2187 gitlab,2188 vlan1,2189 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2190[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-14T09:46:09.814Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2191[]2192[]2193[]2194[]2195[]2196[]2197[]2198[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-14T09:47:01.429312Z', 'started_at': '2026-09-14T09:47:01.669517Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}]2199[{'id': 5, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T09:47:01.648Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2200[{'id': 5, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T09:47:01.648Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2201[{'id': 5, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T09:47:01.648Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2202[{'id': 5, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-14T09:47:01.648Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2203[{'id': 5, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-14T09:47:01.648Z', 'started_at': None, 'finished_at': '2026-09-14T09:47:06.656Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-09-14T09:47:06.813Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2204[{'id': 5, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 4s (1 warning)', 'created_at': '2026-09-14T09:47:01.648Z', 'started_at': None, 'finished_at': '2026-09-14T09:47:06.656Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '31808a3c70b234eea6b1c2d00f8cdd86c33e122c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '1 attributes built', 'created_at': '2026-09-14T09:47:06.813Z', 'started_at': None, 'finished_at': '2026-09-14T09:47:06.987Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]